-- Logs begin at Tue 2022-04-05 12:58:45 UTC, end at Tue 2022-04-05 14:01:11 UTC. -- Apr 05 13:34:08.586429 dv-cinder-835878-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 13:34:08.593715 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 13:34:08 2022] *** Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: nodename: dv-cinder-835878-2-iscsi Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: machine: x86_64 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: clock source: unix Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: pcre jit disabled Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: detected number of CPU cores: 4 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: current working directory: / Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: detected binary path: /usr/bin/uwsgi-core Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: your processes number limit is 47680 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: your memory page size is 4096 bytes Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: detected max file descriptor number: 2048 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: lock engine: pthread robust mutexes Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: thunder lock: enabled Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 13:34:08.599581 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 13:34:08.642202 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: Python main interpreter initialized at 0x558bb80c49c0 Apr 05 13:34:08.642202 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: python threads support enabled Apr 05 13:34:08.642202 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: your server socket listen backlog is limited to 100 connections Apr 05 13:34:08.642202 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: your mercy for graceful operations on workers is 90 seconds Apr 05 13:34:08.642599 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 13:34:08.642599 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: *** Operational MODE: preforking *** Apr 05 13:34:08.642873 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: *** uWSGI is running in multiple interpreter mode *** Apr 05 13:34:08.642873 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: spawned uWSGI master process (pid: 109116) Apr 05 13:34:08.643626 dv-cinder-835878-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 13:34:08.645147 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: spawned uWSGI worker 1 (pid: 109117, cores: 1) Apr 05 13:34:08.645147 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: spawned uWSGI worker 2 (pid: 109118, cores: 1) Apr 05 13:34:08.645147 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 13:34:09.840103 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 13:34:09.843372 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 13:34:10.702727 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:34:10.702727 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: from cryptography.utils import int_from_bytes Apr 05 13:34:10.703009 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:34:10.703009 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: from cryptography.utils import int_from_bytes Apr 05 13:34:10.703157 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:34:10.703157 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: from cryptography.utils import int_from_bytes Apr 05 13:34:10.703337 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:34:10.703337 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: from cryptography.utils import int_from_bytes Apr 05 13:34:13.243929 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 13:34:13.244470 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 13:34:13.244561 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 13:34:13.244935 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 13:34:13.245018 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 13:34:13.245096 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 13:34:13.245230 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 13:34:13.245395 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 13:34:13.245593 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 13:34:13.245720 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.245849 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 13:34:13.245993 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246231 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246318 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246555 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246642 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246872 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.246957 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247190 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247318 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247564 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247657 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247890 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.247980 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248222 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248319 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248484 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248574 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248803 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.248898 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249106 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249203 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-2-iscsi {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249420 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249520 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249733 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.249827 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-2-iscsi {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250045 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250141 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250346 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250441 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250654 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250744 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.250969 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251059 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251269 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251358 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251612 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251801 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.251909 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.252252 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.252436 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.252610 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.252715 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.252884 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.253669 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.253831 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.254070 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.254263 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.254461 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.254641 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.254830 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.255020 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.255207 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.255405 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.255633 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.255853 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256038 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256199 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256422 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256613 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-2-iscsi {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256793 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.256981 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.257179 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-2-iscsi {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.257359 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.257546 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.257753 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.257944 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.258232 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.258417 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.258594 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.258754 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.258893 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259053 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259184 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259341 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259474 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259624 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259763 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.259890 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260047 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260175 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260299 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260423 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260560 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260695 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.260891 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261023 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261149 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261287 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261443 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261577 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261702 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261833 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.261958 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262097 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262234 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262360 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262484 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262619 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262744 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.262877 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263010 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263137 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263260 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263384 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263524 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263668 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263795 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.263931 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264116 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264249 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264389 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264517 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264642 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264773 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.264899 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265035 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265168 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265301 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265427 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265551 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265681 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265816 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.265942 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266074 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266200 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266331 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266331 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266575 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266708 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266833 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.266958 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267088 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267222 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267348 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267488 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267718 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267843 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.267966 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268105 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268241 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268400 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268530 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268743 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.268879 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269084 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269212 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269369 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269503 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269673 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.269802 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270008 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270137 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270319 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270456 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270621 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270757 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.270933 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271056 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271239 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271367 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271560 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271707 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271865 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.271992 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272163 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272289 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272477 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272625 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272792 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.272920 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273048 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273181 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273307 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273439 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273607 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273727 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.273912 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274047 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274215 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274352 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274513 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274646 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274815 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.274945 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275111 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275230 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275402 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275575 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275731 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.275858 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276033 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276171 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276335 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276471 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276638 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276766 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.276940 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277069 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277239 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277376 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277539 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277675 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277841 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.277970 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278141 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278280 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278454 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278594 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278758 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.278887 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279056 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279183 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279355 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279519 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279683 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279829 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.279985 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280123 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280293 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280422 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280593 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280731 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.280894 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281024 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281205 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281342 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281546 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281672 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281797 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.281923 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282088 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282227 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282389 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282519 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282692 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282835 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.282999 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283136 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283294 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283429 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283621 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283754 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.283928 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284074 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284231 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284369 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284557 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284684 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.284862 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285005 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285168 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285314 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285474 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285602 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285777 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.285907 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286083 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286214 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286383 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286519 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286702 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.286845 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287021 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287158 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287338 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287467 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287672 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287803 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.287981 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.288116 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.288284 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.288411 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.288599 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:34:13.288735 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.288931 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289069 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289261 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289400 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289575 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289701 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.289899 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290026 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290226 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290366 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290544 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290671 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290857 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.290993 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291168 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291301 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291480 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291651 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291817 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.291953 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292127 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292437 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292566 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292746 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.292875 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293059 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293196 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293376 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293521 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293691 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.293825 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294006 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294147 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294322 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294457 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294632 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294759 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.294939 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295115 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295254 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295370 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295591 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295722 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.295904 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296034 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296208 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296335 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296545 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296675 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.296874 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297003 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297180 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297308 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297502 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297631 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297813 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.297942 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298119 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298245 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298425 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298563 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298734 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.298863 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299052 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299181 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299362 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299548 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299707 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.299837 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.300544 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.300687 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.300965 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301104 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301304 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301424 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301614 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301741 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.301924 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302060 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302231 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302358 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302564 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302693 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.302878 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303007 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303188 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303316 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303515 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303646 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303833 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.303963 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304140 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304268 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304448 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304584 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304788 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.304915 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305041 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305166 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305328 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305456 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305629 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305759 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.305930 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306069 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306227 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306354 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306546 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306677 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306857 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.306992 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307160 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307296 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307481 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307626 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307804 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.307931 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308112 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308419 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308547 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308720 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.308848 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309019 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309155 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309326 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309463 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309630 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309764 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.309928 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310064 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310245 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310376 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310549 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310675 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310848 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.310976 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311164 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311293 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311463 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311628 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311772 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.311900 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312085 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312213 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312391 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312521 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312694 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.312824 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313000 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313141 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313305 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313442 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313616 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313744 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.313921 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314055 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314228 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314367 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314558 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314686 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314860 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.314987 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.315173 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.315309 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.315511 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.316210 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.316414 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.316559 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.316731 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.316871 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.317035 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.317175 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.317342 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.317470 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.317897 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318038 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318201 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318331 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318502 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318632 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318809 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.318940 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319112 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319240 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319416 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319596 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319735 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.319863 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320034 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320171 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320336 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320464 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320655 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320794 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.320962 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321091 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321262 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321399 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321563 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321684 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.321864 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322002 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322201 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322338 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322504 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322638 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322838 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.322967 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323168 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323306 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323484 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323643 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323819 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.323955 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324131 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324268 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324443 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324577 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324749 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.324906 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325057 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325195 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325364 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325493 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325671 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325791 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.325980 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326117 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326283 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326417 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326598 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326726 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.326904 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327035 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327215 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327342 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327537 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327668 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327856 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.327985 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328157 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328284 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328468 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328613 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328805 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.328935 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329125 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329254 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329438 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329575 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329750 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.329879 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330055 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330183 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330368 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330505 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330675 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330809 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.330983 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.331135 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.331351 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.331542 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.331700 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.331892 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332021 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332215 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332346 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332526 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332656 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332843 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.332972 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333151 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333280 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333472 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333602 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333784 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.333914 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334117 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334325 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334455 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334588 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334721 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.334847 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335012 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335149 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335342 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335479 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335659 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335787 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.335975 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336114 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336294 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336422 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336600 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336727 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.336903 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337044 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337210 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337337 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337514 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337653 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337818 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.337948 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338125 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338253 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338434 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338562 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338736 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.338865 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339041 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339167 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339342 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339481 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339652 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339779 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.339964 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340093 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340265 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340400 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340568 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340699 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.340875 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341004 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341190 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341328 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341497 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341636 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341799 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.341926 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342104 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342241 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342403 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342530 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342704 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.342834 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343016 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343153 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343320 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343447 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343647 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343777 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.343950 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344090 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344250 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344380 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344579 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344720 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.344882 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345011 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345184 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345320 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345495 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345623 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345809 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.345938 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.346114 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.346249 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.346422 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.346549 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.346727 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.347405 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.347586 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.347715 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.347900 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348031 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348212 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348343 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348522 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348651 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348833 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.348961 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349145 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349275 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349466 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349595 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349775 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.349913 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350087 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350223 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350396 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350528 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350700 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.350841 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351003 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351138 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351309 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351438 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351641 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.351900 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352030 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352235 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352504 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352641 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352834 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.352964 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353149 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353278 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353465 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353594 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353782 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.353920 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354232 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354429 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354557 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354736 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.354878 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355049 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355180 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355355 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355518 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355687 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355816 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.355993 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356130 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356296 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356428 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356599 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356727 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.356900 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357029 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357204 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357334 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357504 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357632 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357808 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.357935 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358108 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358235 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358407 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358536 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358742 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.358871 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359003 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359129 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359290 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359419 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359616 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359746 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.359923 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360057 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360224 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360362 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360526 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360655 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360831 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.360968 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361128 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361264 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361428 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361568 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361726 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.361856 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.362062 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.362200 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.362364 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363086 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363222 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363348 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363572 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363707 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.363913 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364042 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364214 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364340 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364514 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364643 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364820 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.364954 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365120 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365245 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365420 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365550 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365721 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.365859 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366022 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366148 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366325 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366460 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366624 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366758 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.366931 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367071 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367232 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367383 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367546 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367672 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367853 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.367995 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368151 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368285 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368458 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368587 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368757 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.368893 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369058 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369184 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369362 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369491 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369658 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369798 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.369956 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370085 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370464 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370588 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370697 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.370881 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371002 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371137 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371287 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371424 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371571 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371765 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.371892 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372065 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372185 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372369 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372504 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372670 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372798 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.372973 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373101 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373279 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373408 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373580 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373710 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.373884 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374020 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374190 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374320 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374500 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374630 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374802 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.374964 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375107 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375268 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375418 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375610 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375763 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.375977 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376107 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376349 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376479 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376668 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376796 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.376973 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377279 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377419 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377585 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377728 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.377894 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378065 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378265 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378425 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378634 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378832 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.378966 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379092 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379239 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379376 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379562 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379705 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379844 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.379971 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380143 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380280 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380448 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380599 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380766 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.380902 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381071 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381199 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381375 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381513 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381679 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381809 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.381980 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382110 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382317 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382448 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382623 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382752 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.382951 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383080 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383262 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383391 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383594 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383736 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.383910 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384047 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384216 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384353 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384533 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384662 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384844 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.384973 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385153 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385281 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385456 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385584 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385760 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.385899 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386070 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386198 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386372 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386500 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386674 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386816 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.386990 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387117 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387295 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387422 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387626 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387841 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.387979 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388105 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388229 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388354 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388527 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388666 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388839 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.388969 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389143 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389270 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389450 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389579 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389755 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.389892 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390061 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390190 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390367 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390496 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390673 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390808 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.390980 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391108 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391288 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391418 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391620 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391752 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.391933 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392063 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392236 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392366 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392542 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392670 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392850 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.392989 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393152 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393287 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393461 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393591 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393793 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.393932 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394098 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394292 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394448 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394599 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394729 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.394990 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395119 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395293 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395422 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395649 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395779 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.395960 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396090 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396271 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396400 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396581 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396719 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.396895 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.397025 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.397203 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.397331 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.401123 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.402785 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404159 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404322 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404459 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404590 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404720 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.404866 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405006 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405135 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405260 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405385 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405510 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405646 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405782 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.405909 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406034 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406159 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406298 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406426 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406552 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406684 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406811 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.406811 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407061 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407187 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407312 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407437 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407591 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407718 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407854 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.407988 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408122 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408381 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408506 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408649 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408776 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.408776 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.409014 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.409146 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.409808 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.409952 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410140 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410290 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410417 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410541 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410676 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410802 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.410802 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411039 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411245 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411383 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411551 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411694 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411830 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.411960 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412085 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412209 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412333 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412458 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412582 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412709 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412834 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.412958 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413084 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413216 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413350 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413477 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413477 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413711 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413835 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.413975 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414228 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414353 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414477 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414601 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414744 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414871 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.414996 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415128 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415254 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415385 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415536 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415677 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415813 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.415813 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416051 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416051 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416303 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416436 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416562 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416684 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416810 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.416943 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417069 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417195 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417319 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417451 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417584 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417719 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417846 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.417971 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418104 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418239 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418365 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418499 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418626 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418752 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.418877 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419001 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419126 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419260 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419394 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419540 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419680 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419807 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.419942 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420076 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420203 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420328 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420452 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420577 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420711 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420837 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.420962 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421099 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421232 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421360 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421496 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421622 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421755 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.421881 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422006 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422131 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422381 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422507 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422639 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422765 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.422900 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423033 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423158 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423283 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423407 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423548 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423692 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423820 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.423945 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424078 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424204 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424337 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424472 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424600 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424725 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.424857 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.425522 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.425654 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.425789 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.425922 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426048 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426172 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426296 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426428 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426553 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426687 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426803 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.426926 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427050 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427182 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427308 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427439 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427610 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427610 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427859 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.427993 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428118 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428241 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428365 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428488 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428611 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428745 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.428870 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429001 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429126 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429250 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429383 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429510 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429633 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429758 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.429881 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430004 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430141 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430267 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430390 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430513 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430636 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430759 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.430884 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431009 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431137 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431262 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431386 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431528 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431669 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431797 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.431922 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432047 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432172 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432306 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432439 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432565 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432690 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432812 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.432939 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433076 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433203 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433336 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433462 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433594 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433728 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433864 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.433864 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434117 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434241 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434366 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434492 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434626 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434626 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434864 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.434995 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435123 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435256 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435382 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435533 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435661 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435661 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.435897 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436038 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436174 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436301 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436435 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436568 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436685 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436819 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.436946 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437071 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437197 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437368 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437509 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437688 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.437818 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438007 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438144 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438329 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438467 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438658 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438804 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.438971 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439100 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439281 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439423 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439606 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439735 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.439914 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440044 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440238 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440369 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440597 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440771 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.440901 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441032 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441213 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441346 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441524 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441654 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441833 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.441971 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.442142 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.442279 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.442449 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.442578 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443011 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443149 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443321 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443458 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443659 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443791 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.443967 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444107 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444277 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444406 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444587 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444717 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.444908 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445062 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445220 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445348 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445538 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445669 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.445845 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446055 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446192 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446373 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446502 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446704 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.446953 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447144 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447297 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447425 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447606 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447751 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.447930 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448060 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448252 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448382 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448566 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448710 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.448873 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449010 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449185 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449315 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449495 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449634 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449801 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.449930 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.450124 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.450254 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.450436 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.450750 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.450750 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451035 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451162 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451288 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451431 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451578 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451706 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.451890 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452022 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452244 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452395 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452566 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452769 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.452900 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453113 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453244 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453433 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453565 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453752 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.453883 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454074 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454205 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454388 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454532 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454692 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.454832 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455011 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455159 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455315 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455445 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455639 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455767 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.455937 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456083 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456275 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456431 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456588 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456783 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.456928 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457067 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457204 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457343 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457470 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457626 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.457795 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458000 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458130 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458256 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458382 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458508 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458692 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.458824 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459006 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459148 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459312 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459442 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459642 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459775 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.459950 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460082 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460255 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460387 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460570 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460702 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.460874 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461003 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461178 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461309 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461481 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461611 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461779 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.461915 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462086 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462225 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462385 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462514 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462692 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462829 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.462992 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.463132 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.463298 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.463434 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.463685 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.463815 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464003 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464143 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464309 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464442 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464613 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464743 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.464927 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465138 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465277 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465415 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465542 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465666 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465836 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.465967 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.466143 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.466391 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.466524 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.466723 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.466863 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467044 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467300 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467423 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467657 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467797 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.467975 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468107 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468303 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468434 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468607 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468735 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.468926 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469064 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469230 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469361 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469533 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469672 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469841 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.469970 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470148 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470278 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470457 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470595 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470764 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.470893 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.471070 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.471199 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.471376 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.471535 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.471718 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.472383 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.472537 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.472744 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.472888 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473017 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473258 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473396 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473578 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473710 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.473886 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474029 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474199 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474329 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474512 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474654 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474834 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.474965 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475150 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475278 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475459 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475639 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475794 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.475926 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476105 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476241 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476414 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476552 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476718 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.476846 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477022 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477153 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477329 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477475 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477641 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477770 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.477963 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478094 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478275 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478414 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478579 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478709 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.478973 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479280 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479409 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479620 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479762 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.479940 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480070 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480249 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480387 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480566 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480704 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.480886 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481026 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481194 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481324 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481511 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481642 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481822 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.481960 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482148 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482278 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482475 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482611 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482789 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.482928 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483097 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483227 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483403 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483574 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483720 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.483848 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484022 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484160 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484329 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484459 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484630 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484760 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.484940 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485068 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485243 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485380 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485539 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485682 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485842 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.485972 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486141 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486270 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486443 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486580 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486742 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.486880 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.487041 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.487180 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.487341 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.487531 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.488202 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.488335 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.488616 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.488758 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.488894 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489033 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489168 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489304 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489439 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489582 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489717 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489845 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.489978 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490106 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490253 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490394 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490557 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490700 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.490889 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491020 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491222 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491354 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491554 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491689 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491867 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.491998 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492176 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492307 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492496 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492642 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492812 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.492943 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493132 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493264 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493451 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493588 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493757 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.493895 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494112 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494258 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494386 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494522 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494677 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.494887 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495017 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495149 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495276 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495408 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495603 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495752 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.495909 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496038 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496216 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496347 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496523 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496668 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496827 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.496960 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497132 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497262 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497453 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497596 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497769 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.497900 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498067 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498189 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498390 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498521 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498696 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.498825 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499009 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499138 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499318 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499448 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499648 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499789 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.499959 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500094 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500265 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500395 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500569 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500698 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.500874 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501016 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501179 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501310 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501484 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501613 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501794 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.501934 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502235 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502423 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502560 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502741 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.502885 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.503118 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.503442 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.503597 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.503726 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.503872 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504002 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504129 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504257 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504463 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504600 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504771 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.504904 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.505037 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 13:34:13.505210 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.505518 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.505821 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:34:13.506064 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 13:34:13.527620 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_db.sqlalchemy.engines [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.528657 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_db.sqlalchemy.engines [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.591117 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.context [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1188cfe2-0516-4a8d-9d16-70266a041a17(cell1) {{(pid=109118) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 13:34:13.594071 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.context [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1188cfe2-0516-4a8d-9d16-70266a041a17(cell1) {{(pid=109117) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 13:34:13.597742 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:34:13.599043 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_concurrency.lockutils [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:34:13.599663 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:34:13.600669 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_concurrency.lockutils [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:34:13.601064 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:34:13.601466 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_concurrency.lockutils [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:34:13.603217 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:34:13.603398 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_concurrency.lockutils [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:34:13.615982 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_db.sqlalchemy.engines [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.618895 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_db.sqlalchemy.engines [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.621641 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_db.sqlalchemy.engines [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.755830 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_db.sqlalchemy.engines [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.776850 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_db.sqlalchemy.engines [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:13.779819 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG oslo_db.sqlalchemy.engines [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:34:14.234197 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: WARNING keystonemiddleware.auth_token [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:34:14.235341 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: WARNING keystonemiddleware.auth_token [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:34:14.242093 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: WARNING keystonemiddleware.auth_token [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:34:14.242664 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: WARNING keystonemiddleware.auth_token [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:34:14.468018 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: WARNING keystonemiddleware.auth_token [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:34:14.473885 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: WARNING keystonemiddleware.auth_token [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:34:14.476244 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: WARNING keystonemiddleware.auth_token [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:34:14.479223 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558bb80c49c0 pid: 109117 (default app) Apr 05 13:34:14.481282 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:34:14.481406 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: WARNING keystonemiddleware.auth_token [None req-705b6f51-8514-4fd3-959b-a75b14baadf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:34:14.482433 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Apr 05 13:34:14.483115 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Tue Apr 5 13:34:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:34:14.486800 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558bb80c49c0 pid: 109118 (default app) Apr 05 13:35:33.592161 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:33.593166 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 05 13:35:33.593570 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:34.031252 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-8ad37a8f-5e08-4377-8ff3-42a6acb08c0a admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:34.061069 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-8ad37a8f-5e08-4377-8ff3-42a6acb08c0a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459357 Apr 05 13:35:34.061913 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Apr 5 13:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:36.430092 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:36.431106 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-dca896b3-ead9-471c-b884-cf24640113ac None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Apr 05 13:35:36.431569 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:36.492313 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-3d96225a-a5c4-4017-ad73-b51f9ac6d017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:36.511484 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:35:36.511484 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:35:36.545653 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-3d96225a-a5c4-4017-ad73-b51f9ac6d017 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107579 Apr 05 13:35:36.546700 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:35:36.768910 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d55ef161-34bd-4b17-aa68-efd6de504fef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:36.771334 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:35:36.771334 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: warnings.warn(msg) Apr 05 13:35:36.820258 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d55ef161-34bd-4b17-aa68-efd6de504fef admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265598 Apr 05 13:35:36.820854 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Apr 5 13:35:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:39.249404 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-3d96225a-a5c4-4017-ad73-b51f9ac6d017 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:39.250439 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-3d96225a-a5c4-4017-ad73-b51f9ac6d017 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Apr 05 13:35:39.250848 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:39.368278 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-73260c1a-d5f3-48fc-801e-cea7daf4d808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:39.386290 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:35:39.386290 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: warnings.warn(msg) Apr 05 13:35:39.413774 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-73260c1a-d5f3-48fc-801e-cea7daf4d808 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157127 Apr 05 13:35:39.414606 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:39.427093 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-951e7db2-4477-41f5-a051-5811deb7f759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:39.428828 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:35:39.428828 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:35:39.467284 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-951e7db2-4477-41f5-a051-5811deb7f759 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043481 Apr 05 13:35:39.468017 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Apr 5 13:35:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:35:41.872032 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-73260c1a-d5f3-48fc-801e-cea7daf4d808 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:41.873723 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-73260c1a-d5f3-48fc-801e-cea7daf4d808 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Apr 05 13:35:41.874123 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:41.944065 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-3c2d6211-f705-4526-8f65-71911843c916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d2"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:41.973532 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-3c2d6211-f705-4526-8f65-71911843c916 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093411 Apr 05 13:35:41.976048 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:41.986965 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-2029f963-1a35-4740-b6c3-9c3d2a6c9e1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:42.010787 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-2029f963-1a35-4740-b6c3-9c3d2a6c9e1a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027664 Apr 05 13:35:42.019060 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Apr 5 13:35:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:35:44.408210 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-3c2d6211-f705-4526-8f65-71911843c916 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:44.409258 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-3c2d6211-f705-4526-8f65-71911843c916 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 05 13:35:44.409671 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:44.469739 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-57f56dbb-a340-4bc3-949d-173e24e013cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "disk": 10, "ram": 2048}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:44.487298 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-57f56dbb-a340-4bc3-949d-173e24e013cc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071819 Apr 05 13:35:44.487884 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:44.500426 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-543ea6d7-9e25-44fc-8b00-3ba2fc931dac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:44.523338 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-543ea6d7-9e25-44fc-8b00-3ba2fc931dac admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027465 Apr 05 13:35:44.524052 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Apr 5 13:35:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:46.941255 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-57f56dbb-a340-4bc3-949d-173e24e013cc admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:46.942901 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-57f56dbb-a340-4bc3-949d-173e24e013cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Apr 05 13:35:46.943549 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:47.001893 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:47.028637 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079325 Apr 05 13:35:47.029946 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:47.042099 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-1077a594-8108-4e48-96f1-c66065de7dc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:47.070449 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-1077a594-8108-4e48-96f1-c66065de7dc1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032910 Apr 05 13:35:47.071010 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Apr 5 13:35:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:49.454852 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:49.456163 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Apr 05 13:35:49.456574 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:49.520469 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-1b2d8d0d-ccd1-44d4-b5cc-50040e77f56d admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:49.544347 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-1b2d8d0d-ccd1-44d4-b5cc-50040e77f56d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080331 Apr 05 13:35:49.545653 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Apr 5 13:35:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:35:51.923153 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:51.924967 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-63790e6f-785b-41fc-a037-436318a0c123 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Apr 05 13:35:51.925388 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:35:51.996261 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-f9377481-2a94-4415-a977-e3894ec92a04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:52.014469 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-f9377481-2a94-4415-a977-e3894ec92a04 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082933 Apr 05 13:35:52.015024 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:52.026777 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-5e5b82a4-e2d5-4cd1-a34d-458fcd2dced0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:52.052278 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-5e5b82a4-e2d5-4cd1-a34d-458fcd2dced0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029127 Apr 05 13:35:52.052871 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Apr 5 13:35:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:54.945885 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-f9377481-2a94-4415-a977-e3894ec92a04 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:54.946902 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-f9377481-2a94-4415-a977-e3894ec92a04 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Apr 05 13:35:54.947309 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:35:55.026299 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-1ab45f0a-c86a-4e9a-a628-f94f21df502b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:55.046772 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-1ab45f0a-c86a-4e9a-a628-f94f21df502b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092716 Apr 05 13:35:55.047347 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:35:55.060821 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-85e70d5b-2c29-4e7f-955d-3eeba5534a0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:55.084979 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-85e70d5b-2c29-4e7f-955d-3eeba5534a0d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028257 Apr 05 13:35:55.085571 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Apr 5 13:35:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:35:57.557315 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-1ab45f0a-c86a-4e9a-a628-f94f21df502b admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:35:57.558327 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-1ab45f0a-c86a-4e9a-a628-f94f21df502b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 05 13:35:57.558876 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:35:57.618372 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d6e4af6c-f1a9-4c8f-9530-b4ee15980dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "ram": 4096, "vcpus": 2}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:57.637802 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d6e4af6c-f1a9-4c8f-9530-b4ee15980dc3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072765 Apr 05 13:35:57.638356 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:35:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:35:57.650436 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9aeecade-8a76-4d8f-a499-f1f7be27b585 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:35:57.672017 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-9aeecade-8a76-4d8f-a499-f1f7be27b585 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025203 Apr 05 13:35:57.672573 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Apr 5 13:35:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:36:00.034232 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d6e4af6c-f1a9-4c8f-9530-b4ee15980dc3 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:00.035252 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d6e4af6c-f1a9-4c8f-9530-b4ee15980dc3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 05 13:36:00.035691 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:00.099267 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-b39e89db-8b8a-4d05-be99-ae943349ff35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:00.117137 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-b39e89db-8b8a-4d05-be99-ae943349ff35 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075658 Apr 05 13:36:00.117681 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:36:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:00.129415 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-eec6beb0-ba23-4c88-b4da-5868f4cb7b1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:00.157278 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-eec6beb0-ba23-4c88-b4da-5868f4cb7b1e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031473 Apr 05 13:36:00.157859 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Apr 5 13:36:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:36:02.562555 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-b39e89db-8b8a-4d05-be99-ae943349ff35 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:02.564248 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-b39e89db-8b8a-4d05-be99-ae943349ff35 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002784 Apr 05 13:36:02.564839 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:36:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:02.631558 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5"}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:02.649534 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078971 Apr 05 13:36:02.650390 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Apr 5 13:36:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:02.663116 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-aa7b5677-0f9b-4e01-aa85-7fe035284a79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:02.697320 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-aa7b5677-0f9b-4e01-aa85-7fe035284a79 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037778 Apr 05 13:36:02.699643 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Apr 5 13:36:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:36:26.174358 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:26.175381 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 05 13:36:26.175837 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:26.232843 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-66c61157-9484-4ae6-8794-cebd62ec2b7c admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:26.250585 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-66c61157-9484-4ae6-8794-cebd62ec2b7c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068738 Apr 05 13:36:26.251151 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Apr 5 13:36:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:36:27.638475 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:27.639484 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-ef043018-bd73-4e65-83b0-f08331e1a31e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Apr 05 13:36:27.639908 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:27.831580 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9eebf62d-43a1-4b1a-bc7e-76c068e3c055 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:27.837383 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.wsgi [None req-9eebf62d-43a1-4b1a-bc7e-76c068e3c055 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 13:36:27.837952 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9eebf62d-43a1-4b1a-bc7e-76c068e3c055 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:27.838747 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-9eebf62d-43a1-4b1a-bc7e-76c068e3c055 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058240 Apr 05 13:36:27.839260 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Apr 5 13:36:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 05 13:36:27.849296 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-8efa178f-4862-4a1d-a675-438cfa4199dc admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:27.869669 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-8efa178f-4862-4a1d-a675-438cfa4199dc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023959 Apr 05 13:36:27.870207 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:36:27.880479 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-8b8c90c9-081b-47b6-bfbe-05f972a099cb admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:27.901520 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-8b8c90c9-081b-47b6-bfbe-05f972a099cb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024780 Apr 05 13:36:27.902064 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:36:27.912068 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-977e41db-8226-4c36-8d62-d7585ca428c5 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:27.917378 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.wsgi [None req-977e41db-8226-4c36-8d62-d7585ca428c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 13:36:27.917939 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-977e41db-8226-4c36-8d62-d7585ca428c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:27.918714 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-977e41db-8226-4c36-8d62-d7585ca428c5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010280 Apr 05 13:36:27.919203 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Apr 5 13:36:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 13:36:29.202770 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-8b8c90c9-081b-47b6-bfbe-05f972a099cb admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:29.204444 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-8b8c90c9-081b-47b6-bfbe-05f972a099cb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Apr 05 13:36:29.207535 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:29.397264 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-a2a2e850-461b-4e8d-ac4e-bad01d6a0d39 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:29.402868 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.wsgi [None req-a2a2e850-461b-4e8d-ac4e-bad01d6a0d39 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 13:36:29.403422 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-a2a2e850-461b-4e8d-ac4e-bad01d6a0d39 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:29.404234 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-a2a2e850-461b-4e8d-ac4e-bad01d6a0d39 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058690 Apr 05 13:36:29.404740 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Apr 5 13:36:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 13:36:29.414768 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-898334ae-1c49-441a-8991-6bbc6a2433ef admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:29.428650 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-898334ae-1c49-441a-8991-6bbc6a2433ef admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 Apr 05 13:36:29.429199 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:36:29.439314 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-dea11550-c05e-4362-8ec8-49c60e089270 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:29.452787 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-dea11550-c05e-4362-8ec8-49c60e089270 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017727 Apr 05 13:36:29.453301 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:36:29.463304 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-62cf0563-4429-43a4-9dd4-8850a9468a60 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:29.468502 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.wsgi [None req-62cf0563-4429-43a4-9dd4-8850a9468a60 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 13:36:29.469067 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-62cf0563-4429-43a4-9dd4-8850a9468a60 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:29.470171 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-62cf0563-4429-43a4-9dd4-8850a9468a60 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010387 Apr 05 13:36:29.470675 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Apr 5 13:36:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 13:36:30.721595 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-dea11550-c05e-4362-8ec8-49c60e089270 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:30.722622 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-dea11550-c05e-4362-8ec8-49c60e089270 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Apr 05 13:36:30.723013 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:30.910648 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9c060545-919d-4869-beba-5b4f7ee33914 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:30.915901 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.wsgi [None req-9c060545-919d-4869-beba-5b4f7ee33914 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 13:36:30.916462 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9c060545-919d-4869-beba-5b4f7ee33914 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:30.917249 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-9c060545-919d-4869-beba-5b4f7ee33914 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058328 Apr 05 13:36:30.917768 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:36:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 13:36:30.927675 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-92f1850c-6c89-4ac5-964d-825661de1538 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:30.941591 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-92f1850c-6c89-4ac5-964d-825661de1538 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017664 Apr 05 13:36:30.942103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:36:30.951608 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:30.964754 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017088 Apr 05 13:36:30.965281 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Apr 5 13:36:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:36:30.974613 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-2e0cbdb3-00a7-4687-8dc0-adfbd206d56e admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:30.979691 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.wsgi [None req-2e0cbdb3-00a7-4687-8dc0-adfbd206d56e admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 13:36:30.980244 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-2e0cbdb3-00a7-4687-8dc0-adfbd206d56e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:36:30.981035 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-2e0cbdb3-00a7-4687-8dc0-adfbd206d56e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009941 Apr 05 13:36:30.981519 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:36:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 13:36:32.253141 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:32.254173 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 05 13:36:32.254540 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:32.442576 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-1a57e87a-97b3-40f7-9491-4fc1eea79849 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:32.459741 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-1a57e87a-97b3-40f7-9491-4fc1eea79849 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068995 Apr 05 13:36:32.460537 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Apr 5 13:36:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:33.738197 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:33.739671 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Apr 05 13:36:33.740205 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:33.930477 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-06aa21ac-3bb7-41e6-8e97-368bac5c3962 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:33.947792 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-06aa21ac-3bb7-41e6-8e97-368bac5c3962 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069545 Apr 05 13:36:33.948400 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Apr 5 13:36:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:35.234157 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:35.235201 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Apr 05 13:36:35.236207 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:35.436415 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-2fbd561c-a486-4309-8996-b7baa961fbb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:35.453818 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-2fbd561c-a486-4309-8996-b7baa961fbb0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070342 Apr 05 13:36:35.454367 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Apr 5 13:36:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:36.739140 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:36.740318 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Apr 05 13:36:36.740788 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:36.930112 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-285c8988-1475-445f-b7e7-19211671a091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:36:36.948054 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-285c8988-1475-445f-b7e7-19211671a091 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069674 Apr 05 13:36:36.948625 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Apr 5 13:36:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:36:38.214441 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:38.215447 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Apr 05 13:36:38.215893 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:36:38.404100 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-ab97ff48-cf27-4798-b5bf-c194f283422b admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:36:38.424229 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-ab97ff48-cf27-4798-b5bf-c194f283422b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071130 Apr 05 13:36:38.424700 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Tue Apr 5 13:36:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:37:32.748065 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.749098 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-ceb43b7a-a850-422a-9df8-eb06a1038051 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 05 13:37:32.749496 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:37:32.806425 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-61994c77-4175-4d78-80c4-1da0d6aafd86 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.826367 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-61994c77-4175-4d78-80c4-1da0d6aafd86 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070229 Apr 05 13:37:32.826891 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:37:32.849036 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-6f191a49-a3a1-4a74-b9d6-880f113b1e4c admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.856561 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-6f191a49-a3a1-4a74-b9d6-880f113b1e4c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011728 Apr 05 13:37:32.857100 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:37:32.868898 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-815cc122-b6ce-4f1b-b481-fb8889fff133 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.876305 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-815cc122-b6ce-4f1b-b481-fb8889fff133 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010971 Apr 05 13:37:32.876816 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:37:32.888380 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-a3ff0001-db9e-4bbf-bf24-5af8fc3b99a6 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.895742 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-a3ff0001-db9e-4bbf-bf24-5af8fc3b99a6 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010837 Apr 05 13:37:32.896259 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:37:32.907335 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:37:32.915088 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011187 Apr 05 13:37:32.915639 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Tue Apr 5 13:37:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:39:14.903259 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-8c195018-441e-47b1-a657-e5ac9aa14895 tempest-verify_tempest_config-86077805 tempest-verify_tempest_config-86077805-project] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:39:14.905273 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-8c195018-441e-47b1-a657-e5ac9aa14895 tempest-verify_tempest_config-86077805 tempest-verify_tempest_config-86077805-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112988 Apr 05 13:39:14.905835 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 34/69] 10.222.0.59 () {58 vars in 1133 bytes} [Tue Apr 5 13:39:14 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:41:01.650509 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:01.651828 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001803 Apr 05 13:41:01.652227 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 36/70] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:41:01.909617 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:01.910797 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:41:01.910797 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:41:01.912073 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:01.912515 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:01.913342 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:01.913775 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:01.948380 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-2cb1b672-f298-4535-a0a1-f1bc63a90f63 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155387 Apr 05 13:41:01.948945 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 35/71] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:41:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:41:03.259201 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:03.260319 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 05 13:41:03.260991 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 37/72] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:41:03.464551 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:03.465692 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:41:03.465692 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:41:03.466867 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:03.467327 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:03.468132 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:03.468555 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:03.488111 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-4e23d5e9-354f-4b0e-af69-c2bccfcba80e admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075233 Apr 05 13:41:03.488682 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 36/73] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:41:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:41:15.234502 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:15.235570 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Apr 05 13:41:15.236103 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 38/74] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:41:15.430541 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:15.431752 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:41:15.431752 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:41:15.433502 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:15.433941 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:15.434733 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:15.435166 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:15.460138 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-9907f851-64cf-46b4-aa01-a0249c78d2d7 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081700 Apr 05 13:41:15.460624 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 37/75] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:41:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:41:16.744963 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: DEBUG nova.api.openstack.wsgi [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] Calling method '>' {{(pid=109117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:16.745963 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: INFO nova.api.openstack.requestlog [None req-d381108f-7aa4-40da-a570-6e9d00a1b478 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Apr 05 13:41:16.746359 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: [pid: 109117|app: 0|req: 39/76] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Apr 5 13:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:41:16.935195 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG nova.api.openstack.wsgi [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] Calling method '>' {{(pid=109118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:41:16.936386 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 13:41:16.936386 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: warnings.warn(msg) Apr 05 13:41:16.937591 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:16.938056 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:16.938830 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:41:16.939253 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: DEBUG oslo_concurrency.lockutils [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:41:16.961598 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: INFO nova.api.openstack.requestlog [None req-13514326-087f-41af-a756-a0f2d91e0c96 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077448 Apr 05 13:41:16.962076 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: [pid: 109118|app: 0|req: 38/77] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Apr 5 13:41:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:42:20.326409 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: Tue Apr 5 13:42:20 2022 - graceful shutdown triggered... Apr 05 13:42:20.326186 dv-cinder-835878-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 05 13:42:20.327450 dv-cinder-835878-2-iscsi devstack@n-api.service[109117]: Gracefully killing worker 1 (pid: 109117)... Apr 05 13:42:20.327957 dv-cinder-835878-2-iscsi devstack@n-api.service[109118]: Gracefully killing worker 2 (pid: 109118)... Apr 05 13:42:21.326273 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: worker 1 buried after 1 seconds Apr 05 13:42:21.326273 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: worker 2 buried after 1 seconds Apr 05 13:42:21.326273 dv-cinder-835878-2-iscsi devstack@n-api.service[109116]: goodbye to uWSGI. Apr 05 13:42:21.327906 dv-cinder-835878-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 05 13:42:21.328478 dv-cinder-835878-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 05 13:42:21.331275 dv-cinder-835878-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 13:42:21.346639 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 13:42:21 2022] *** Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: nodename: dv-cinder-835878-2-iscsi Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: machine: x86_64 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: clock source: unix Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: pcre jit disabled Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: detected number of CPU cores: 4 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: current working directory: / Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: detected binary path: /usr/bin/uwsgi-core Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: your processes number limit is 47680 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: your memory page size is 4096 bytes Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: detected max file descriptor number: 2048 Apr 05 13:42:21.367559 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: lock engine: pthread robust mutexes Apr 05 13:42:21.368658 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: thunder lock: enabled Apr 05 13:42:21.368658 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 13:42:21.368658 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 13:42:21.416981 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: Python main interpreter initialized at 0x557ff47199c0 Apr 05 13:42:21.416981 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: python threads support enabled Apr 05 13:42:21.416981 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: your server socket listen backlog is limited to 100 connections Apr 05 13:42:21.416981 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: your mercy for graceful operations on workers is 90 seconds Apr 05 13:42:21.417446 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 13:42:21.417446 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: *** Operational MODE: preforking *** Apr 05 13:42:21.417680 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: *** uWSGI is running in multiple interpreter mode *** Apr 05 13:42:21.417680 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: spawned uWSGI master process (pid: 123498) Apr 05 13:42:21.417887 dv-cinder-835878-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 13:42:21.418440 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: spawned uWSGI worker 1 (pid: 123519, cores: 1) Apr 05 13:42:21.419102 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: spawned uWSGI worker 2 (pid: 123520, cores: 1) Apr 05 13:42:21.419390 dv-cinder-835878-2-iscsi devstack@n-api.service[123498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 13:42:22.652775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 13:42:22.661672 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 13:42:23.572649 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:42:23.572649 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: from cryptography.utils import int_from_bytes Apr 05 13:42:23.572997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:42:23.572997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: from cryptography.utils import int_from_bytes Apr 05 13:42:23.578034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:42:23.578034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: from cryptography.utils import int_from_bytes Apr 05 13:42:23.578382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 13:42:23.578382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: from cryptography.utils import int_from_bytes Apr 05 13:42:25.974552 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 13:42:25.975116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 13:42:25.975685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 13:42:25.976024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 13:42:25.976280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 13:42:25.976679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.977014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.977345 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.977670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.978008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.978332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.978659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.978985 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.979321 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.979614 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.979939 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.980268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-2-iscsi {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.980606 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.980918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.981395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.982191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.982506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.982951 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.983271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.983808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.985269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.985269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.985269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.985269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.986750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.986750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.986750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.986750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.986750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.987842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.987842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-2-iscsi {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.987842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.988455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.988455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.988873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.989094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.989396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.989725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.990059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.990356 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.990692 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.991019 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.991349 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.991698 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.992009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.992325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.992642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.992966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.993279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.993591 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.993845 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.994162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.994488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.994815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.995143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.995400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.995680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.996008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.996336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.996651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.997181 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.997661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.998205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.998494 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.998813 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.999130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.999452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:25.999818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.000145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.000476 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.000792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.001121 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.001535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.001792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.002110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.002458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.002788 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.003103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.003430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.003785 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.004103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.004417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.004730 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.005055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.005413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.005712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.005966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.006273 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.006585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.006910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.007223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.007552 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.007868 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.008175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.008487 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.008803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.009116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.009429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.009742 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.010052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.010365 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.010675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.010987 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.011313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.011664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.011976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.012291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.012675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.013091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.013424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.013743 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.014056 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.014387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.014697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.015010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.015334 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.015675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.015992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.016314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.016621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.016934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.017259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.017572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.017886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.018194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.018504 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.018821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.019134 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.019443 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.019780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.020086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.020412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.020739 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.021055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.021368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.021680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.021998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.022343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.022676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.023021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.023342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.023711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.024044 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.024402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.024685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.025007 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.025339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.025659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.026073 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.026295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.026621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.026946 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.027282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.027956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.027956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.028826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.029127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.029458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.029794 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.030124 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.030444 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.030792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.031144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.031464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.031878 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.032148 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.032467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.032836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.033140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.033417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.033759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.034077 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.034399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.034715 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.035036 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.035352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.035692 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.036010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.036396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.036664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.036986 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.037344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.037622 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.037942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.038257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.038573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.038882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.039198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.039578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.039846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.040156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.040481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.040812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.041124 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.041465 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.041779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.042097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.042411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.042726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.043038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.043350 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.043833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.044829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.045219 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.045569 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.045865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.046197 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.046515 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.046827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.047528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.047528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.047869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.048093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.048411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.048743 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.049065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.049390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.049732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.050070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.050383 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.050715 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.051050 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.051374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.051713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.052033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.052347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.052678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.052966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.053284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.053596 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.053911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.054225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.054539 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.054853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.055181 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.055544 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.055833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.056146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.056460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.057382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.057382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.058150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.058150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.058150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.058592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.058752 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.059043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.059437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.059793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.060116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.060436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.061741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.061741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.061741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.061741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.062460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.062460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.062785 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.063017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.063275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.063616 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.063949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.064277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.064607 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.064923 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.065243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.065560 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.065880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.066199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.066519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.066848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.067164 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.067490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.067828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.068157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.068473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.068798 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.069109 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.069434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.069770 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.070109 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.070426 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.070745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.071075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.071392 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.071734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.072053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.072365 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.072676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.073045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.073207 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 13:42:26.073716 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.073873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 13:42:26.074029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.074179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 13:42:26.074322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.074466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 13:42:26.074618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.074762 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 13:42:26.074906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.075215 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.075367 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.075367 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.075701 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.075962 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.076148 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.076318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.076471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.076634 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.076796 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.077052 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.077212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.077358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.077508 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.077662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.077873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.078027 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.078179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.078332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.078495 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.078640 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.078797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.078942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.079093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.079244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835878-2-iscsi {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.079389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.079627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.079780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.079924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.080067 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.080212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.080364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.080522 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.080675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.080826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.080970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.081120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.081273 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.081427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.081572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.081572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.081861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.082034 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.082187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.082333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.082492 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.082749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.082900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.083043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.083281 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.083434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.083613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.083761 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.083912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.084088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.084256 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.084402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.084546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.084697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.084848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.085007 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.085187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.085407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.085556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835878-2-iscsi {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.085709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.085866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.086011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.086154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.086307 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.086452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.086594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.086746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.086892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.087053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.087053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.087351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.087351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.087692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.087847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.087998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.087998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.088297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.088297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.088582 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.088764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.088933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.089079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.089231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.089406 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.089567 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.089736 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.089899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.090058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.090223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.090368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.090510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.091733 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.091932 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.092096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.092096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.092389 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.092542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.092693 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.092853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.093005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.093149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.093407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.093573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.093720 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.093879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.094031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.094183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.094334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.094479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.094621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.094793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.094941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.095096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.095258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.095435 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.095719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.095916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.096077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.096223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.096366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.096536 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.096702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.096847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.096990 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.097132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.097286 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.097436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.097609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.097754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.097897 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.098048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.098191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.098420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.098567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.098711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.098854 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.098996 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.099151 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.099308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.099452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.099633 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.099786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.099929 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.100073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.100507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.100507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.100804 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.100949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.101100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.101244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.101410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.101555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.101719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.102089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.102248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.102403 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.102556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.102701 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.102853 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.102999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.103217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.103390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.103654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.103815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.103966 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.104185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.104358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.104517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.104517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.104805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.104957 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.105111 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.105263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.105409 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.105568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.105742 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.105970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.106119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.106377 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.107091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.107258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.107441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.107671 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.107841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.108010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.108010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.108010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.108010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.108601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.108793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.108793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.109086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.109235 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.109391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.109543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.109701 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.109853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.110001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.110231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.110392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.110545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.110714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.110865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.111014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.111171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.111321 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.111470 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.111675 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.111828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.111976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.112125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.112273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.112436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.112588 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.112748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.112898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.113062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.113212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.113370 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.113523 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.113768 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.113927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.114085 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.114246 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.114407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.114567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.114726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.114897 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.115062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.115217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.115374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.115627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.115797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.115976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.116211 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.116376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.116527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.116676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.116841 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.116993 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.117154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.117303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.117452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.117609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.117770 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.117922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.118079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.118228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.118386 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.118537 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.118700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.118850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.119000 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.119167 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.119326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.119483 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.119686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.119837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.119995 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.120145 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.120301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.120459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.120618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.120775 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.121013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.121178 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.121328 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.121487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.121646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.121882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.122040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.122199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.122389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.122578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.122739 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.122890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.123047 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.123207 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.123380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.123564 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 13:42:26.123738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.123738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.124102 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.124255 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.124424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.124577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.124577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.125377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.125547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.125706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.125867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.126927 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.127984 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128149 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128475 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128628 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.128940 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129249 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.129896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130214 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130694 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.130853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131323 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131808 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.131968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132298 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.132914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133540 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.133851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134087 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134489 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134643 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.134959 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135425 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.135944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136684 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.136990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.137146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.137311 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.137502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.137675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.137886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.138994 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.139152 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.139312 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.139471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.139670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.139910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.140400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141165 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141782 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.141932 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142249 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142706 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.142865 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.143024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.143770 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.143933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144823 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.144974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145624 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.145923 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146074 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.146947 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.147198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.147355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.147555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.147735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.147929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.148899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149360 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149838 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.149988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150145 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150633 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.150933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.151090 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.151251 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.151408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.151704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.151878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152193 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152503 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152811 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.152970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.153638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.153797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.153948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154255 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154512 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.154994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155312 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.155984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156133 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156282 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156605 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.156931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.157941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.158898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159207 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159372 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159560 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.159868 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160335 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160494 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160656 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.160957 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161426 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161575 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.161873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162190 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.162979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.163932 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164085 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164392 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.164967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165592 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.165990 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166301 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166616 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.166945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.167096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.167337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.167545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.167720 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.167880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.168030 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.168187 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.168346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.168497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.168754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.169045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.169289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.169503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.169757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.169917 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170700 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.170850 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.171995 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172912 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.172912 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173365 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.173997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.174147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.174296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.174445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.175106 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.175342 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.175548 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.175706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.175874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176742 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.176903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177069 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177235 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.177961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178293 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.178914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179579 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.179902 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.180847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181006 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.181943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.182100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.182272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.182423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.182587 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.182757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.183432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.183631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.183783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.183934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.184098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.184251 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.184442 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.184732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.184911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.185942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.186872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187046 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.187959 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188436 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.188737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189331 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.189951 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190735 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.190894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191216 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191557 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.191896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192218 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192371 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192521 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192685 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.192997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193618 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193768 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.193926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194238 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194554 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.194998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.195158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.195317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.195511 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.195750 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.195986 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196143 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196444 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196606 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196770 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.196967 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.197124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.197286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.197446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.197616 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.197851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198016 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198168 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198318 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198473 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198633 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.198796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199612 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.199929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.200634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.200798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.200965 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201131 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201283 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201601 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.201910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.202867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.203837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.204002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.204163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.204321 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.204480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.204640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.205471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.205642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.207232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.207402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.207578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.207755 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.208020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.208182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.208182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.208493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.209367 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.209367 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.209678 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.209838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.209999 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210612 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.210773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.211089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.211251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.211251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.211611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.212332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.212332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.214723 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.214904 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.214904 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.215213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.215461 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.215795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.216554 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.216554 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.217117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.217508 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.217791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.218076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.218455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.218745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.218982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.219144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.219297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.219449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.219667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.219834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.220853 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221006 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221331 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.221871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222503 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222503 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.222974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.223260 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.223410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.223410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.223747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.223908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.224903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.225056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.225460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.225625 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.225777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.225930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226087 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226419 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226746 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.226898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227859 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.227954 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228794 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.228990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229365 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229453 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229539 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229804 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.229980 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230246 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230349 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230447 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.230986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231338 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231721 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.231934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232159 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232243 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232577 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232759 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.232928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233311 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233400 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233485 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.233940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.234788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.235411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236532 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.236877 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237202 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237508 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.237926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.238098 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.238251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.238409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.238670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.238840 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.239833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240403 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.240726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.241965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242119 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.242901 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243051 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243541 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243541 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.243867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244174 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244500 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.244993 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245298 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245611 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245761 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.245913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246241 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246717 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.246892 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.247072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.247314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.247489 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.247489 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.247997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.248880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.249818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250276 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.250915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251245 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251398 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.251921 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252233 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252385 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.252997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253472 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253773 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.253942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254104 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254426 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254587 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 13:42:26.254908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.254908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.255217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.255367 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.255648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.255997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.256273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.256636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.256947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.257271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.257607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.257939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.258253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.258591 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.258932 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.259234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.259578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.259910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.260217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.260527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.260840 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.261148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.261455 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.261761 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.262075 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.262381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.263437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.264142 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.264481 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.264798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.265130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.265450 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.265765 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.266084 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.266397 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.266751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.267063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.267405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.267757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.268086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.268422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.268737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.269070 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.269393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.269713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.270035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.270354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.270674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.270995 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.271315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.271665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.272001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.272322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.274016 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.274016 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.274016 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.274016 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.275058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.275058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.275058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.275058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.275924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.276155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.276457 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.276686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.276915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.277208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.277532 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.277874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.278406 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.279330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.279755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.280573 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.280943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.281270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.281470 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.281656 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.281886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.282206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.282528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.282846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.283164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.283479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.283834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.284154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.284538 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.284773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.285091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.285436 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.286104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.286446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.286768 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.287088 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.287414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.288018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.288342 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.288682 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.289012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.289434 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.289661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.289984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.290316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.290628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.290937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.291251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.291588 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.292073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.292409 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.292728 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.293042 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.293369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.293684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.294864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.295232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.295661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.296211 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.296560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.296896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.297216 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.297553 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.297870 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.298186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.298510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.298828 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.299142 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.299456 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.299790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.300106 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.300416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.300732 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.301041 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.301377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.301689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.302118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.302438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.302759 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.303070 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.303380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.303719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.304031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.304352 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.304671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.304969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.305280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.305595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.305907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.306431 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.306818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.307124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.307436 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.307774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.308099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.308415 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.308815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.309064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.310320 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.310695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.311025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.311610 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.312060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.312398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.312741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.313080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.313397 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.313710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.314023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.314354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.314672 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.315008 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.315296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.315638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.316009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.316468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.317436 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.317805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.318154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.318496 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.318833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.319165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.319533 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.319889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.320228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.320562 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.320891 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.321221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.321543 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.321890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.322186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.322504 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.322830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.323179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.323525 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.323833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.324264 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.324586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.325506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.325829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.326156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.326412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.326739 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.327056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.327381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.327721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.328058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.328399 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.328732 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.329129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.329373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.329684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.330489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.330489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.330826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.330986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.331201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.331531 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.331845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.332154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.332461 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.332766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.333071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.333382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.333689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.333994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.334302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.334607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.334913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.335247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.335717 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.336055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.336236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.336484 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.336715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.337020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.337352 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.337686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.338004 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.338495 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.338666 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.338947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.339257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.339599 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.339925 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.340248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.340629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.341147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.341553 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.341879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.342196 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.343026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.343026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.343357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.343537 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.343789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.344098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.344507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.344743 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.345067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.345440 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.345833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.346141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.346392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.346670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.context [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1188cfe2-0516-4a8d-9d16-70266a041a17(cell1) {{(pid=123520) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 13:42:26.346847 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.347021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.347369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.347717 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.348039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.348423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.348757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.349085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.349417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.349746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.350096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.350756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.351017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.351185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:42:26.351342 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.351681 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.351996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.352303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 13:42:26.352548 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 13:42:26.352831 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:42:26.353680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:42:26.355689 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:42:26.366827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.375854 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.377595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.442509 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.context [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1188cfe2-0516-4a8d-9d16-70266a041a17(cell1) {{(pid=123519) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 13:42:26.446846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:42:26.448542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:42:26.449359 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:42:26.451445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:42:26.462011 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.463724 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.528010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.621296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 13:42:26.971761 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:42:26.978728 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:42:27.057880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:42:27.065051 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:42:27.206304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:42:27.211439 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-af9b939c-5b59-402d-8bda-6761c38cc63c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:42:27.216928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ff47199c0 pid: 123520 (default app) Apr 05 13:42:27.290012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 13:42:27.295819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-59f1734e-4af5-4631-881c-2afe89cc8afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 13:42:27.301119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ff47199c0 pid: 123519 (default app) Apr 05 13:43:09.337396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db704bac-8440-444c-9e43-874efeb7c95c tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Action: 'create', calling method: .version_select at 0x7f9bff6c4310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1265684366", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:09.339132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db704bac-8440-444c-9e43-874efeb7c95c tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:09.340111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-db704bac-8440-444c-9e43-874efeb7c95c tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.809345 Apr 05 13:43:09.340664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Apr 5 13:43:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 812 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 05 13:43:09.574801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dd03e0d0-6316-4d0a-a006-5bec79a21dce tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Action: 'create', calling method: .version_select at 0x7f9bff775f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1341075526", "metadata": {"Type": "work"}}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:09.577309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dd03e0d0-6316-4d0a-a006-5bec79a21dce tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:09.582310 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dd03e0d0-6316-4d0a-a006-5bec79a21dce tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.231810 Apr 05 13:43:09.583308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Apr 5 13:43:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:43:09.594095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0042cd06-837d-4ba1-a9bc-80cbf3f4f914 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Action: 'create', calling method: .version_select at 0x7f9bff5f2160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1082311496", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:09.595731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0042cd06-837d-4ba1-a9bc-80cbf3f4f914 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:09.596650 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0042cd06-837d-4ba1-a9bc-80cbf3f4f914 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007957 Apr 05 13:43:09.597284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Apr 5 13:43:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:43:09.608083 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-21ab4fb1-605b-4576-bd8d-35b700762c47 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Calling method '.version_select at 0x7f9bff714dc0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:10.722130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-21ab4fb1-605b-4576-bd8d-35b700762c47 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] HTTP exception thrown: Volume tempest-invalid-1341706667 could not be found. Apr 05 13:43:10.724054 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-21ab4fb1-605b-4576-bd8d-35b700762c47 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 404 to user: Volume tempest-invalid-1341706667 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:10.725970 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-21ab4fb1-605b-4576-bd8d-35b700762c47 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1341706667" status: 404 len: 99 microversion: 2.1 time: 1.122642 Apr 05 13:43:10.727179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Apr 5 13:43:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1341706667 => generated 99 bytes in 1125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 05 13:43:10.740165 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5e019224-d1a1-4c06-aa47-a4c009e89e90 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005892 Apr 05 13:43:10.749347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1139 bytes} [Tue Apr 5 13:43:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 13:43:10.753355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2d45533e-6d89-49ae-b747-81c9e9c0d2a9 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004586 Apr 05 13:43:10.759747 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1136 bytes} [Tue Apr 5 13:43:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 13:43:10.769985 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-66611e71-811a-42d9-9d6c-653b9939cdb5 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Calling method '.version_select at 0x7f9bff6c4700>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:11.510635 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2143502514", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "networks": [{"uuid": "d92158ae-2893-445f-b641-484828cd96e2"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:11.597877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-66611e71-811a-42d9-9d6c-653b9939cdb5 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] HTTP exception thrown: Volume 278dd376-3fe2-4152-a229-38164d03b4cf could not be found. Apr 05 13:43:11.598664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-66611e71-811a-42d9-9d6c-653b9939cdb5 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 404 to user: Volume 278dd376-3fe2-4152-a229-38164d03b4cf could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:11.599600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-66611e71-811a-42d9-9d6c-653b9939cdb5 tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/278dd376-3fe2-4152-a229-38164d03b4cf" status: 404 len: 109 microversion: 2.1 time: 0.839507 Apr 05 13:43:11.600330 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:43:10 2022] DELETE /compute/v2.1/os-volumes/278dd376-3fe2-4152-a229-38164d03b4cf => generated 109 bytes in 841 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:43:11.610078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a82bae73-b12a-489a-8d50-1d1d91e6875a tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff6c43a0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:11.778381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] validate_networks() for [('d92158ae-2893-445f-b641-484828cd96e2', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:43:11.794284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a82bae73-b12a-489a-8d50-1d1d91e6875a tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43d96b8d-bb9c-4f81-95a4-447b7df8aa53" status: 200 len: 350 microversion: 2.1 time: 0.191827 Apr 05 13:43:11.795756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 5/8] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:43:11 2022] GET /compute/v2.1/os-volumes/43d96b8d-bb9c-4f81-95a4-447b7df8aa53 => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:11.806159 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c4d7f285-98dc-4031-903c-6923aba984dd tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Calling method '.version_select at 0x7f9bff52d4c0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:12.219283 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-c4d7f285-98dc-4031-903c-6923aba984dd tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] HTTP exception thrown: Volume 35f6ec2a-9ece-4591-a5d8-bbacea5b9024 could not be found. Apr 05 13:43:12.220114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c4d7f285-98dc-4031-903c-6923aba984dd tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] Returning 404 to user: Volume 35f6ec2a-9ece-4591-a5d8-bbacea5b9024 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:43:12.220943 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c4d7f285-98dc-4031-903c-6923aba984dd tempest-VolumesNegativeTest-8101802 tempest-VolumesNegativeTest-8101802-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35f6ec2a-9ece-4591-a5d8-bbacea5b9024" status: 404 len: 109 microversion: 2.1 time: 0.420268 Apr 05 13:43:12.221667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 6/9] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:43:11 2022] GET /compute/v2.1/os-volumes/35f6ec2a-9ece-4591-a5d8-bbacea5b9024 => generated 109 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:43:13.710991 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c46b5887-ceea-4b6a-9db3-8efc73717243 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff5381f0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:13.806667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c46b5887-ceea-4b6a-9db3-8efc73717243 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/9b94b032-cbcc-458f-98a9-689504ad3a75" status: 200 len: 351 microversion: 2.1 time: 0.099945 Apr 05 13:43:13.807329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 7/10] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:43:13 2022] GET /compute/v2.1/os-volumes/9b94b032-cbcc-458f-98a9-689504ad3a75 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:43:14.078336 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:43:14.078969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:43:14.079057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:43:14.079439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:43:14.079887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:43:14.126879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:14.130096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:14.134212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:14.134695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:14.232237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Getting quotas for project 0f9aa619aa7b4d4d981db173ab77dbf4. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:14.249979 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Getting quotas for user 89294949f2b14e1f9f3afa03b9e18e60 and project 0f9aa619aa7b4d4d981db173ab77dbf4. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:14.278707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:43:14.301791 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:43:14.466683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2faa14c0-a3e7-4e67-989d-e9a708108a34 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.074117 Apr 05 13:43:14.477711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6d3c32cb-238a-48b2-a77f-75f60018a9de tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:14.478363 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6d3c32cb-238a-48b2-a77f-75f60018a9de tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:14.481976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 4/11] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 13:43:14.816483 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6d3c32cb-238a-48b2-a77f-75f60018a9de tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:14.869920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6d3c32cb-238a-48b2-a77f-75f60018a9de tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1215 microversion: 2.1 time: 0.377877 Apr 05 13:43:14.870619 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 8/12] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:14 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:15.517581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-338ade72-dd25-474e-b233-6e0e7860bfe0 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff49ddc0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:15.688719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-338ade72-dd25-474e-b233-6e0e7860bfe0 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/4581865e-5af2-4b44-9102-b388430dfdb2" status: 200 len: 350 microversion: 2.1 time: 0.177436 Apr 05 13:43:15.689280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 5/13] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:43:15 2022] GET /compute/v2.1/os-volumes/4581865e-5af2-4b44-9102-b388430dfdb2 => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:15.701520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-43b3681b-099f-436c-9301-be75bdc8a525 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff5384c0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:15.888330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c88836b8-26f8-422e-b385-85659c5cfe3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:15.889180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c88836b8-26f8-422e-b385-85659c5cfe3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:15.979318 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-43b3681b-099f-436c-9301-be75bdc8a525 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.282391 Apr 05 13:43:15.979942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 9/14] 10.222.0.59 () {58 vars in 1133 bytes} [Tue Apr 5 13:43:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:15.997667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4e120111-6192-463c-a8e0-fc3c579e8620 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff538700>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:16.218004 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4e120111-6192-463c-a8e0-fc3c579e8620 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.228043 Apr 05 13:43:16.218644 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 10/15] 10.222.0.59 () {58 vars in 1148 bytes} [Tue Apr 5 13:43:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:16.237040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9ac41381-b3d2-4e50-aed7-ec8e6c609b6b tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff5f2550>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:16.354620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9ac41381-b3d2-4e50-aed7-ec8e6c609b6b tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.127757 Apr 05 13:43:16.360451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 11/16] 10.222.0.59 () {58 vars in 1133 bytes} [Tue Apr 5 13:43:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:16.369816 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0cb13c1d-a282-4825-8881-3387ae7506e7 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff4eef70>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:16.561796 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0cb13c1d-a282-4825-8881-3387ae7506e7 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195799 Apr 05 13:43:16.562808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 12/17] 10.222.0.59 () {58 vars in 1166 bytes} [Tue Apr 5 13:43:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:43:16.574372 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5f4697cb-acb0-4123-8d62-795829584334 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff4eeb80>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:16.737686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c88836b8-26f8-422e-b385-85659c5cfe3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:16.762620 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c88836b8-26f8-422e-b385-85659c5cfe3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1215 microversion: 2.1 time: 0.878279 Apr 05 13:43:16.780058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 6/18] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:15 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1215 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:16.810634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5f4697cb-acb0-4123-8d62-795829584334 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.239969 Apr 05 13:43:16.811707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 13/19] 10.222.0.59 () {58 vars in 1169 bytes} [Tue Apr 5 13:43:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:16.828188 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8c7867aa-1dbf-415c-bcc7-3b8d3286af95 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bfec48040>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:17.012157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8c7867aa-1dbf-415c-bcc7-3b8d3286af95 tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.190269 Apr 05 13:43:17.013335 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 7/20] 10.222.0.59 () {58 vars in 1154 bytes} [Tue Apr 5 13:43:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:17.031152 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4aec40cb-3066-4b9e-a197-f0643106d0bf tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff6c4af0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:17.401668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4aec40cb-3066-4b9e-a197-f0643106d0bf tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.381060 Apr 05 13:43:17.402867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 14/21] 10.222.0.59 () {58 vars in 1187 bytes} [Tue Apr 5 13:43:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:17.415369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9cf034f6-94c0-4a1e-945c-5eb8e8435d5a tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] Calling method '.version_select at 0x7f9bff5df310>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:17.663609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9cf034f6-94c0-4a1e-945c-5eb8e8435d5a tempest-VolumesTestJSON-174861721 tempest-VolumesTestJSON-174861721-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.252465 Apr 05 13:43:17.664786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 8/22] 10.222.0.59 () {58 vars in 1154 bytes} [Tue Apr 5 13:43:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:17.788829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:17.789434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:17.805341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:17.805854 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:17.808023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:17.810404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:18.198613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:18.240610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-02e4d7f2-8ad0-422b-a02e-58df488a31b3 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1211 microversion: 2.1 time: 0.454984 Apr 05 13:43:18.243305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 15/23] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:17 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1211 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:19.265450 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:19.266845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:19.298708 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:19.299226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:19.304724 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:19.305366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:19.782113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:19.805459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9fbb109a-9b1d-44a8-a032-5d9b09c6f88d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1273 microversion: 2.1 time: 0.547151 Apr 05 13:43:19.814822 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 9/24] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:19 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1273 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:20.833082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:20.834351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:20.869876 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:20.871817 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:20.875404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:20.887817 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:21.288637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:21.300400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2910955e-7012-438c-a5b0-232b3f832df2 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1273 microversion: 2.1 time: 0.471080 Apr 05 13:43:21.301012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 16/25] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:20 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1273 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:22.320483 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:22.321790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:22.332480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:22.337413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:22.344092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:22.344092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:22.837672 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:22.858477 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d75fb62b-4440-4994-a310-f89acc43fd25 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1273 microversion: 2.1 time: 0.538552 Apr 05 13:43:22.863155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 10/26] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:22 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1273 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:23.878888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:23.879772 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:23.891471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:23.900347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:23.901662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:23.908217 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:24.233837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: .version_select at 0x7f9bfe393790>, body: {"keypair": {"name": "tempest-keypair-1240488737"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:24.288875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:24.295273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:24.829266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:24.852551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:24.914006 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fb367192-8e41-4150-a363-01bbb5f03a4d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.985592 Apr 05 13:43:24.928559 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 11/27] 10.222.0.59 () {62 vars in 1198 bytes} [Tue Apr 5 13:43:23 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1001 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 05 13:43:27.044675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:27.064029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-85c959f8-7845-4825-bd89-c834ac093067 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 3.188389 Apr 05 13:43:27.066879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 17/28] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:23 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 3193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:28.085122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:28.085755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:28.115652 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:28.116177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:28.126467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:28.126982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:30.349543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-3ecd4b32-3d36-4504-8e9e-b86120628dca req-6a8c83b3-136a-4e6c-9387-92a2cf299601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35196-d7f4-483e-911a-fd38d893ce72", "tag": "b47f837a-6c09-4dfa-a6fe-b54f99471784"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:30.367101 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3ecd4b32-3d36-4504-8e9e-b86120628dca req-6a8c83b3-136a-4e6c-9387-92a2cf299601 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:30.367477 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3ecd4b32-3d36-4504-8e9e-b86120628dca req-6a8c83b3-136a-4e6c-9387-92a2cf299601 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:30.441706 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-3ecd4b32-3d36-4504-8e9e-b86120628dca req-6a8c83b3-136a-4e6c-9387-92a2cf299601 service nova] Creating event network-changed:b47f837a-6c09-4dfa-a6fe-b54f99471784 for instance cbe35196-d7f4-483e-911a-fd38d893ce72 on hv-cinder-83587 Apr 05 13:43:30.442390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3ecd4b32-3d36-4504-8e9e-b86120628dca req-6a8c83b3-136a-4e6c-9387-92a2cf299601 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 13:43:30.443894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:30.445203 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:30.447794 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:30.450269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:30.495001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.compute.rpcapi [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 13:43:30.496496 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] Releasing lock "compute-rpcapi-router" {{(pid=123520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 13:43:30.563067 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-550ef471-b30c-4e69-a537-b2e6c4ec080f None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.908554 Apr 05 13:43:30.564036 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 18/29] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:43:30.584642 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:30.605792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0c81fbbb-fb6c-48f6-9df3-812380210ea5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 2.523266 Apr 05 13:43:30.606481 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 12/30] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:28 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:31.631684 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:31.634119 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:31.650600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:31.652415 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:31.656730 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:31.686748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:32.300647 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:32.312364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-41bcd5d1-b2f6-43a5-b384-7b8948d9af08 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.687314 Apr 05 13:43:32.313897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 19/31] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:31 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:32.568485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1573748451", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36092869-544a-41e5-a4a1-8d365ffa3fa5"}], "security_groups": [{"name": "tempest-securitygroup--388441432"}], "key_name": "tempest-keypair-1240488737", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:33.333034 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:33.333677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:33.345291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:33.346032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:33.347130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:33.349390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:33.702676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] validate_networks() for [('36092869-544a-41e5-a4a1-8d365ffa3fa5', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:43:34.638638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:34.652888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-be280f59-02ce-4d95-9a1b-9b2e133bdb17 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 1.320195 Apr 05 13:43:34.655720 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 20/32] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:33 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:34.992780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:43:34.993208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:43:34.993715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:43:34.994134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:43:34.994707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:43:35.013200 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:35.013661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:35.018503 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:35.018983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:35.104418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:35.116385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:35.151344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:43:35.154386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:43:35.326134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ea78c7a2-2536-4f04-b84d-f276326b9387 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.762223 Apr 05 13:43:35.326796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 13/33] 10.222.0.59 () {62 vars in 1187 bytes} [Tue Apr 5 13:43:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 13:43:35.419657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: .version_select at 0x7f9bff4205e0>, body: {"keypair": {"name": "tempest-keypair-2068836186"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:36.059827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:36.083095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:36.816798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-951939496", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:36.937447 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] validate_networks() for [('4f94a67a-4b4c-4b0c-b628-6c4483480757', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:43:36.956700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:36.977818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:37.038077 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bf19caf5-e460-4740-8bc5-5d10b2fc5af9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.380980 Apr 05 13:43:37.045742 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 21/34] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:43:34 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:37.061282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:37.061898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:37.237526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:37.245373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:37.258563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:37.264668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bac2f5e4-bdfe-4e80-99dd-55073d84ef87 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1282 microversion: 2.20 time: 0.217465 Apr 05 13:43:37.265267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 22/35] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:37 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:37.303301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:37.303301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:37.317286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:37.317760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:37.336264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:37.336858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:37.880496 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:37.889144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c7cd5406-c906-478e-a8e1-58a1d149c307 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.622795 Apr 05 13:43:37.889966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 23/36] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:37 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:38.280756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:43:38.283218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:43:38.284222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:43:38.284793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:43:38.285341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:38.285948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:43:38.286212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:38.292338 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.298793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.300701 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.302192 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.303030 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.304132 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.308220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.309195 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.357800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:38.372662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for user a24d703a07794f56b600cc29c0a1578d and project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:38.394079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:43:38.396647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:43:38.439104 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:38.451040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:38.455977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:38.457442 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-69ebc82f-0809-4967-8ca5-29b0ee7b1e2b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1286 microversion: 2.20 time: 0.177118 Apr 05 13:43:38.473686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 24/37] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:38 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:38.488301 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2c9a86f5-012a-4f78-bade-de0ccce15618 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.159971 Apr 05 13:43:38.490249 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 14/38] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:43:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:43:38.502399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4b35d836-54e4-4947-aba7-d2ea62a9b4c8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:38.503260 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4b35d836-54e4-4947-aba7-d2ea62a9b4c8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:38.920360 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:38.924953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:38.935400 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.936077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.937023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:38.938460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:38.952683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4b35d836-54e4-4947-aba7-d2ea62a9b4c8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:38.967541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4b35d836-54e4-4947-aba7-d2ea62a9b4c8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1221 microversion: 2.1 time: 0.464080 Apr 05 13:43:38.969271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 25/39] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:38 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1221 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:39.255439 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-580718639", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:39.490648 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] validate_networks() for [('4f94a67a-4b4c-4b0c-b628-6c4483480757', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:43:39.566110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:39.579078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-47a16e0e-e752-4a3d-97a4-8abfd83bde6f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.672601 Apr 05 13:43:39.582642 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 15/40] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:38 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:39.589232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:39.592526 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:39.603780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:39.604611 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:39.605674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:39.606341 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:39.746887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:39.772219 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:39.775041 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:39.776530 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d0fbbf74-6cbf-43af-907f-f6a8fb578197 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1286 microversion: 2.20 time: 0.192539 Apr 05 13:43:39.777560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 16/41] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:39 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:40.599653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:40.600583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:40.614594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:40.618302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:40.620075 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:40.625846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:40.698429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:43:40.699841 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:43:40.700037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:43:40.700448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:43:40.700856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:43:40.721234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:40.729760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:40.731812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:40.732688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:40.808695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:40.813749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for user a24d703a07794f56b600cc29c0a1578d and project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:40.828223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:43:40.836170 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:43:40.997117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8f07ab45-065f-4e68-8c11-cc3241d916e2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.765841 Apr 05 13:43:40.999395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 26/42] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:43:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:43:41.018690 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1769619799", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3cff852-d241-43ab-830a-cae40270149a"}], "security_groups": [{"name": "tempest-securitygroup--669399468"}], "key_name": "tempest-keypair-2068836186", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:41.148572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:41.170974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d7ccfe75-a2f5-408d-a36d-a50773113497 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.571403 Apr 05 13:43:41.174160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 17/43] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:40 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:41.194572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:41.198586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:41.219842 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:41.226837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:41.227857 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:41.230671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:41.351413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] validate_networks() for [('c3cff852-d241-43ab-830a-cae40270149a', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:43:41.522576 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:41.550557 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:41.558736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:41.582410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-847aed8f-7d2a-4606-9a74-37a902af00be tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1334 microversion: 2.20 time: 0.404787 Apr 05 13:43:41.583322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 18/44] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:41 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1334 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:41.616928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-791137c1-922e-4975-b6b5-6f4022c44aa4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:41.619715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-791137c1-922e-4975-b6b5-6f4022c44aa4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:41.803845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-791137c1-922e-4975-b6b5-6f4022c44aa4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:41.814603 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-791137c1-922e-4975-b6b5-6f4022c44aa4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1221 microversion: 2.1 time: 0.226640 Apr 05 13:43:41.818780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 19/45] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:41 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:42.190076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:42.191442 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:42.200830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:42.211702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:42.216346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:42.220441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.088321 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.093621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:43:43.094225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:43:43.094529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:43:43.095028 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:43:43.095924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:43:43.102965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ff512e71-0f5a-41c7-bb04-ec18109ef96d tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.916905 Apr 05 13:43:43.109899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 20/46] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:42 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:43.120247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:43.121960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.122986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:43.127226 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.131046 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.132827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.144715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.146551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.148103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.148830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.214651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:43:43.238193 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:43:43.280528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:43:43.287460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:43:43.401141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-47e98213-1644-49ae-bbbe-23e7262d2057 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.400099 Apr 05 13:43:43.403316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 27/47] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:43:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:43:43.413059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:43.415886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:43.427416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.428527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.439568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:43.440408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:43.659787 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.675520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-46f2a776-0483-42b7-84a3-20b221e1825e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1291 microversion: 2.1 time: 0.266737 Apr 05 13:43:43.677283 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 28/48] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:43 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1291 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:43.699996 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2b050297-1f99-48e7-9337-bb7a5956ec7c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:43.703671 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2b050297-1f99-48e7-9337-bb7a5956ec7c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:43.800556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.819085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.826303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.831003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3da6b8f6-7d13-4c80-bdb3-67ddda36cda0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1340 microversion: 2.20 time: 0.719662 Apr 05 13:43:43.833534 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 21/49] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:43 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1340 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:43.880317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2b050297-1f99-48e7-9337-bb7a5956ec7c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:43.908197 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2b050297-1f99-48e7-9337-bb7a5956ec7c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1242 microversion: 2.1 time: 0.227012 Apr 05 13:43:43.919670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 29/50] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:43 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1242 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:44.133190 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:44.134079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:44.147237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.147997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.150017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.154047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.696226 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:44.696732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:44.708737 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.709408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.710357 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.710942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.843943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:44.854817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ceff2f42-25f3-49bd-8124-c1758a7744cc tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.725286 Apr 05 13:43:44.861582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 22/51] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:44 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:44.876850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:44.877523 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:44.898322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.898778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.901009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.908661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:44.916092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.916788 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2b7e2223-17c1-4c87-b58d-7a4acd0e6ab7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1279 microversion: 2.1 time: 0.224588 Apr 05 13:43:44.917485 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 30/52] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:44 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:44.937623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:44.939585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:44.956956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.957412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:44.958190 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:44.958640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:45.478299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:45.495963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:45.496593 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5a2a66d8-3c5e-4bd4-b886-55603b120428 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1302 microversion: 2.1 time: 0.571787 Apr 05 13:43:45.499420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 31/53] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:44 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1302 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:45.514627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:45.516545 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:45.518018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ce50ae38-97ad-4aba-9c0e-63758872def4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.655132 Apr 05 13:43:45.518820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 23/54] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:44 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:45.879641 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:45.880413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:45.892097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:45.894053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:45.896593 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:45.899206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:45.935566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:45.937289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:45.947751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:45.953830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:45.954951 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:45.955789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.139774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:46.150517 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a2b61cee-2acc-4142-94a5-c5b122073577 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1279 microversion: 2.1 time: 0.219502 Apr 05 13:43:46.163890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 24/55] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:45 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:46.387524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-1a43bca1-c089-4db1-b959-d216f9a9933f req-ad783974-c5c0-4c41-b36a-67917a426b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe35196-d7f4-483e-911a-fd38d893ce72", "name": "network-vif-plugged", "status": "completed", "tag": "b47f837a-6c09-4dfa-a6fe-b54f99471784"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:46.399963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1a43bca1-c089-4db1-b959-d216f9a9933f req-ad783974-c5c0-4c41-b36a-67917a426b99 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.401721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1a43bca1-c089-4db1-b959-d216f9a9933f req-ad783974-c5c0-4c41-b36a-67917a426b99 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.451736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-1a43bca1-c089-4db1-b959-d216f9a9933f req-ad783974-c5c0-4c41-b36a-67917a426b99 service nova] Creating event network-vif-plugged:b47f837a-6c09-4dfa-a6fe-b54f99471784 for instance cbe35196-d7f4-483e-911a-fd38d893ce72 on hv-cinder-83587 Apr 05 13:43:46.452398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1a43bca1-c089-4db1-b959-d216f9a9933f req-ad783974-c5c0-4c41-b36a-67917a426b99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 13:43:46.455252 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.455933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.458099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.458712 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.468561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.compute.rpcapi [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 13:43:46.469738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 13:43:46.506241 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9d750888-3e96-4264-94ce-f577df6390e4 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236709 Apr 05 13:43:46.508945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 25/56] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:46.516439 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:46.530556 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d1f30665-1bd0-4870-9ead-69dd9abca07b tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.655054 Apr 05 13:43:46.560065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 32/57] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:45 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:46.561982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:46.567713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:46.578900 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:46.581765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:46.587773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.589276 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.592426 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.595677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.597067 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.600691 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:46.603961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:46.604424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:47.084201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:47.094795 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-238b8fe7-830d-44c9-94f4-f35d9a61fb99 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1300 microversion: 2.1 time: 0.573539 Apr 05 13:43:47.106741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 26/58] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:46 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1300 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:47.170158 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:47.171054 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:47.178365 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:47.185751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:47.186630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:47.187082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:47.685910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:47.694790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f02c06c0-c7db-4d8a-8ab8-0497825373ea tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.528828 Apr 05 13:43:47.704861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 27/59] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:47 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:47.710311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-8151fe87-6043-49a7-95e4-a2cc1b1a7793 req-67ffffe7-8ed7-4ef1-8eb1-cf0decf2ea90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:47.722958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8151fe87-6043-49a7-95e4-a2cc1b1a7793 req-67ffffe7-8ed7-4ef1-8eb1-cf0decf2ea90 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:47.723627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8151fe87-6043-49a7-95e4-a2cc1b1a7793 req-67ffffe7-8ed7-4ef1-8eb1-cf0decf2ea90 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:47.748791 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-8151fe87-6043-49a7-95e4-a2cc1b1a7793 req-67ffffe7-8ed7-4ef1-8eb1-cf0decf2ea90 service nova] Creating event network-changed:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:43:47.759014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-8151fe87-6043-49a7-95e4-a2cc1b1a7793 req-67ffffe7-8ed7-4ef1-8eb1-cf0decf2ea90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052872 Apr 05 13:43:47.760220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 28/60] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:47.768089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:47.770447 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:47.791239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:47.793088 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:47.794517 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:47.795226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:48.013140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:48.027629 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:48.030033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:48.031421 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-255d1e6e-4ea3-4c82-8dd7-69dae7771cac tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 1.468671 Apr 05 13:43:48.032247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 33/61] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:46 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:48.120049 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:48.123956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:48.132169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:48.132747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:48.134227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:48.134738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:48.306278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:48.320063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-18e3e5d3-8231-43f8-bf12-27eef10af7ca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.552976 Apr 05 13:43:48.321079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 29/62] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:47 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:48.359539 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:48.369312 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1a83eb02-efd0-409f-9f46-7d05a0eb37bc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1300 microversion: 2.1 time: 0.260472 Apr 05 13:43:48.379986 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 34/63] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:48 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:48.725805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:48.729210 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:48.752096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:48.754796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:48.756965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:48.758003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.123089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-6195f0db-39dc-40df-9eba-40ea14e25c8a req-ed313c5e-0eb3-4c7c-8079-7db40348853b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ef91a-434a-4c31-85d2-c1352a5208f3", "tag": "2b817a5d-3997-48f5-8143-c7c5935059ae"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:49.141702 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6195f0db-39dc-40df-9eba-40ea14e25c8a req-ed313c5e-0eb3-4c7c-8079-7db40348853b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.143901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6195f0db-39dc-40df-9eba-40ea14e25c8a req-ed313c5e-0eb3-4c7c-8079-7db40348853b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.168441 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-6195f0db-39dc-40df-9eba-40ea14e25c8a req-ed313c5e-0eb3-4c7c-8079-7db40348853b service nova] Creating event network-changed:2b817a5d-3997-48f5-8143-c7c5935059ae for instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 on hv-cinder-83587 Apr 05 13:43:49.181840 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-6195f0db-39dc-40df-9eba-40ea14e25c8a req-ed313c5e-0eb3-4c7c-8079-7db40348853b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178853 Apr 05 13:43:49.184188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 35/64] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:49.202262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:49.205178 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:49.215191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.217381 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.224451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.225059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.416591 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:49.429052 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3e71bb74-e82d-4616-9aa7-3d1a5871ba95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.719393 Apr 05 13:43:49.429928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 30/65] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:48 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:49.448087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:49.449631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:49.461053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.461800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.462786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.463424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.775078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:49.782746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e648de4b-b9ff-4209-8726-3c58021a30ad tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1315 microversion: 2.1 time: 0.351353 Apr 05 13:43:49.783393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 31/66] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:49 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:49.789407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:49.790395 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:49.798419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.799092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.800050 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:49.800631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:49.895646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:49.919583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:49.921999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:49.923222 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4acd82a6-0517-4c02-9c3a-cbeaf85b7ff9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.735888 Apr 05 13:43:49.936222 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 36/67] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:49 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:50.300086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:50.311080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b21027f8-7f7e-4d92-ac81-7bc0e22c706f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.525286 Apr 05 13:43:50.312160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-d0b2a37b-09e4-47cd-bcec-ebc0f298396a req-ddf8e3b5-f43e-459a-8e87-4f06861ecdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcf398b-babb-4847-a7f6-19219fca641e", "tag": "e655642e-a80e-43df-bfde-59c9592afe81"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:50.313203 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 32/68] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:49 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:50.327114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-d0b2a37b-09e4-47cd-bcec-ebc0f298396a req-ddf8e3b5-f43e-459a-8e87-4f06861ecdb2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.327830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-d0b2a37b-09e4-47cd-bcec-ebc0f298396a req-ddf8e3b5-f43e-459a-8e87-4f06861ecdb2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.343282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-d0b2a37b-09e4-47cd-bcec-ebc0f298396a req-ddf8e3b5-f43e-459a-8e87-4f06861ecdb2 service nova] Creating event network-changed:e655642e-a80e-43df-bfde-59c9592afe81 for instance 3dcf398b-babb-4847-a7f6-19219fca641e on hv-cinder-83587 Apr 05 13:43:50.357050 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-d0b2a37b-09e4-47cd-bcec-ebc0f298396a req-ddf8e3b5-f43e-459a-8e87-4f06861ecdb2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051387 Apr 05 13:43:50.357697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 37/69] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:50.446186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:50.446796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:50.454946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.455450 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.456259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.456694 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.785396 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:50.795296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0cb9db93-5d7e-4a51-8f42-2fbb43f4d87b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.352077 Apr 05 13:43:50.796814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 33/70] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:50 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:50.804632 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:50.805397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:50.812096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.812540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.813304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.813734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.944014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:50.945692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:50.957891 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.960305 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:50.963465 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:50.968069 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:51.244792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:51.256793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5b7333e7-c59c-4c97-b288-7c64696e2f57 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1501 microversion: 2.1 time: 0.460388 Apr 05 13:43:51.257244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 38/71] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:50 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1501 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:51.275360 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7680a0fe-d7f7-4171-a1c4-f582323bbb0b req-fbfe92da-8126-4fb9-9091-5d6e17a2797d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01eed230-0576-46ce-89ed-577fe3bafe14", "tag": "5e0130be-6ae6-413d-a3ae-c2ae43b030f9"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:51.293644 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7680a0fe-d7f7-4171-a1c4-f582323bbb0b req-fbfe92da-8126-4fb9-9091-5d6e17a2797d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:51.294417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7680a0fe-d7f7-4171-a1c4-f582323bbb0b req-fbfe92da-8126-4fb9-9091-5d6e17a2797d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:51.310123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7680a0fe-d7f7-4171-a1c4-f582323bbb0b req-fbfe92da-8126-4fb9-9091-5d6e17a2797d service nova] Creating event network-changed:5e0130be-6ae6-413d-a3ae-c2ae43b030f9 for instance 01eed230-0576-46ce-89ed-577fe3bafe14 on hv-cinder-83587 Apr 05 13:43:51.327410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7680a0fe-d7f7-4171-a1c4-f582323bbb0b req-fbfe92da-8126-4fb9-9091-5d6e17a2797d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068436 Apr 05 13:43:51.329948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 39/72] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:51.345583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:51.346519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:51.363025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:51.363437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:51.364252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:51.364693 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:51.378798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:51.390515 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:51.393311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:51.394583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-82e3cbfd-ab22-4486-a92b-743265b3ae6f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.454773 Apr 05 13:43:51.395391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 34/73] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:50 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:43:51.629433 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:51.641930 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-75c38f9d-5007-444e-a97c-27a71290f92a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.309307 Apr 05 13:43:51.645446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 40/74] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:51 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:51.815368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:51.816014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:51.821774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:51.822431 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:51.823799 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:51.824493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:52.084029 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:52.092522 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-89e6dd30-fe72-430e-8794-ada1bc14b57b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.281393 Apr 05 13:43:52.100429 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 35/75] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:51 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:52.414111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:52.414719 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:52.424823 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:52.426328 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:52.429372 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:52.430805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:52.674316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:52.678441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:52.698813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:52.699705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:52.701014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:52.701941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:52.959763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:52.981020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8f52e5ae-d78a-4220-aa63-620a038b514d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.322063 Apr 05 13:43:52.981636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 36/76] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:52 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:52.996563 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75664301-6d53-4485-b5ea-db397915a9ee"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:52.997953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:53.004265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:53.004927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:53.005837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:53.006448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:53.025936 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:53.036698 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:53.038350 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:53.039614 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7e67e34a-b8cf-48df-8d18-78c98208c949 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.629860 Apr 05 13:43:53.040691 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 41/77] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:52 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:53.111554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:53.112413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:53.119629 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:53.120156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:53.121043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:53.121638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:53.294885 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:53.312416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3de1a5e0-3cbf-4834-bae0-1b0846392dce tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.206085 Apr 05 13:43:53.313013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 42/78] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:53 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:53.899784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d14107b4-0ebf-4fde-a43d-e01b54d74046 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "POST /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905274 Apr 05 13:43:53.900535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 37/79] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:43:52 2022] POST /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:53.999517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:54.001262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:54.014801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.015264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.018513 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.019250 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.064314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:54.065841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:54.076317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.077139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.078103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.078729 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.264793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:54.282173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e91eb164-85a0-4c06-9251-6f96dcaf2ae9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.286362 Apr 05 13:43:54.282782 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 43/80] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:53 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:54.288754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-db984d76-aeba-481e-873b-46bc45af57fb req-9d88b990-d248-467b-80ca-4aca457486f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "name": "network-vif-plugged", "status": "completed", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:43:54.314585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-db984d76-aeba-481e-873b-46bc45af57fb req-9d88b990-d248-467b-80ca-4aca457486f2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.315025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-db984d76-aeba-481e-873b-46bc45af57fb req-9d88b990-d248-467b-80ca-4aca457486f2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.337906 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:54.340825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-db984d76-aeba-481e-873b-46bc45af57fb req-9d88b990-d248-467b-80ca-4aca457486f2 service nova] Creating event network-vif-plugged:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:43:54.348840 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:54.349816 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-db984d76-aeba-481e-873b-46bc45af57fb req-9d88b990-d248-467b-80ca-4aca457486f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065847 Apr 05 13:43:54.350875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:54.352992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3c2c6996-4ba4-471d-862f-c90b82b8c4eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.294988 Apr 05 13:43:54.353746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 38/81] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:54 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:54.355871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 44/82] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:43:54.362454 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:54.363689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:54.372099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.372771 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.373974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:54.374566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:54.552942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:54.563373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7454db6c-46fe-4430-89c6-f5bb5d1100b5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.208080 Apr 05 13:43:54.564109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 39/83] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:54 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:55.301536 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:55.303086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:55.311464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.312169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.313776 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.314597 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.373325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:55.373942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:55.381685 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.382198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.383471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.383982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.474341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:55.484734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9faafc4d-a608-4396-82ac-6093bab204b9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.187540 Apr 05 13:43:55.486240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 45/84] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:55 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:55.581882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:55.582497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:55.594822 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.595276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.596189 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:55.596621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:55.702692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:55.722866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:55.725381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:55.728252 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-14915d37-102e-4497-8241-56856617145b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.359876 Apr 05 13:43:55.728966 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 40/85] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:55 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:43:55.806313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:55.824286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1213964d-2acd-4355-9ffb-6cedbf53bbb7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.246140 Apr 05 13:43:55.824875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 46/86] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:55 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:56.502194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:56.503668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:56.510331 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.511092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.512171 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.512874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.668370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:56.676670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-164533bc-0e30-436f-b1f0-336d12c9fa52 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.178242 Apr 05 13:43:56.679652 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 41/87] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:56 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:56.746358 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:56.747135 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:56.753615 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.754063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.754836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.755271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.842234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:56.843101 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:56.850856 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.852290 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.853242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:56.853837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:56.939152 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:56.948952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:56.951844 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:56.955968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4153d229-5835-4d7e-8cd9-64f98f08f7c8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.213620 Apr 05 13:43:56.956804 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 47/88] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:56 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:57.019185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:57.028242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-92d18167-e16e-4950-89d3-25f04262e415 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.190778 Apr 05 13:43:57.029119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 42/89] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:56 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:57.700718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:57.701625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:57.715110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:57.717708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:57.720759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:57.722966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:57.907420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:57.915771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fce48637-08eb-4183-b566-abd860c29b36 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.225544 Apr 05 13:43:57.916339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 48/90] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:57 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:57.973954 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:57.975240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:57.983512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:57.984443 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:57.985644 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:57.986619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:58.045550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:58.046169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:58.052171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:58.052570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:58.053356 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:58.053798 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:58.148110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:58.162156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:58.164401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:58.167585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-39f9c42b-0648-48f0-acf7-87eb105332c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.196333 Apr 05 13:43:58.168449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 43/91] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:57 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:58.250916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:58.259033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-871883a3-7da3-4f9c-888c-0b9722b03f05 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.217260 Apr 05 13:43:58.259644 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 49/92] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:58 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:43:58.936147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:58.936147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:58.939623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:58.940082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:58.941057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:58.941507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:59.072983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:59.080900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c1c4a075-a872-4167-ad11-48a50f4cf4ae tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.151785 Apr 05 13:43:59.081477 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 44/93] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:58 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:43:59.188762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:59.189365 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:59.195263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:59.195798 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:59.196553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:59.196977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:59.276293 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:43:59.276940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:43:59.283130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:59.284185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:59.285305 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:43:59.285928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:43:59.337894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:59.346188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:59.348510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:59.349100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a27c225f-0acd-4234-a0a4-f327d37fe102 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.164134 Apr 05 13:43:59.350017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 50/94] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:43:59 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:43:59.422985 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:43:59.430340 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e06e05af-4aa8-42d0-8e1f-3bac8249a551 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.157924 Apr 05 13:43:59.430914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 45/95] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:43:59 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:00.097823 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:00.098348 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:00.104562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.105010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.105756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.106185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.234309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:00.241408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-24862120-70d2-435d-ad45-3a4c35dd56f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.147467 Apr 05 13:44:00.241977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 51/96] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:00 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:00.368257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:00.368786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:00.375178 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.375673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.376456 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.376906 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.448125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:00.449587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:00.456375 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.456913 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.457802 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:00.458450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:00.516821 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:00.525879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:00.528611 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:00.529730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f9ff32e9-813c-4870-8e4c-eb81328cf684 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.165519 Apr 05 13:44:00.530487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 46/97] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:44:00 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:44:00.635040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:00.642886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-297b4726-1d2a-4579-91ee-2fab341ccfaf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.198584 Apr 05 13:44:00.643454 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 52/98] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:00 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:01.259020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:01.259613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:01.278460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.279351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.280297 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.280839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.441574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:01.449671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-989f2ac0-32b0-4ae8-a248-8b442775bf2b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.195009 Apr 05 13:44:01.450252 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 47/99] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:01 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:01.548749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:01.549354 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:01.555095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.555576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.556350 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.556793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.662934 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:01.663760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:01.670702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.671324 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.672351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:01.672730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:01.713277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:01.732600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:01.734430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:01.735767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9cebf69d-dd59-42a4-a428-244513d1a9cf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1407 microversion: 2.20 time: 0.190932 Apr 05 13:44:01.736510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 53/100] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:44:01 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:44:01.832919 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:01.841207 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3f1ce68c-566f-48e6-8d5a-d5bd833b0baf tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.184191 Apr 05 13:44:01.841792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 48/101] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:01 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:02.467041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:02.467681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:02.473708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.474155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.474911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.475339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.674447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:02.683097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8e78f31e-b071-4986-b0d4-9d4796b11e1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.220008 Apr 05 13:44:02.683759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 54/102] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:02 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:02.763884 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:02.764493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:02.770855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.771385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.772240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.772744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.859893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:02.860725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:02.867514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.867963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.868724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.869194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.907383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:02.915412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:02.917212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:02.918354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-41044c50-e375-46c7-bc60-6ec7853a048a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1599 microversion: 2.20 time: 0.167658 Apr 05 13:44:02.918930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 49/103] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:44:02 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:44:02.936723 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:02.937306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:02.943126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.943691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:02.944534 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:02.945117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:03.015152 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:03.022589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7354bc68-7bcf-4a5d-b398-a1fa54f125d4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.168118 Apr 05 13:44:03.023177 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 55/104] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:02 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:03.031775 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7dbf3357-6f8e-489d-89b8-a4da8148aece tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099455 Apr 05 13:44:03.032361 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 50/105] 10.222.0.59 () {60 vars in 1315 bytes} [Tue Apr 5 13:44:02 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:44:03.699916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:03.700522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:03.706236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:03.706682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:03.707436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:03.707925 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:03.865459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:03.873270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-15690791-2513-412e-a909-5a80e1027608 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.177068 Apr 05 13:44:03.873779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 56/106] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:03 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:04.040238 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:04.041840 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:04.049875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.050521 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:04.051660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.052269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:04.067478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-3c4d25b6-7690-4c30-8e10-b50e9985885d req-873f0076-93b1-4473-986d-e2f2995a7ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcf398b-babb-4847-a7f6-19219fca641e", "name": "network-vif-plugged", "status": "completed", "tag": "e655642e-a80e-43df-bfde-59c9592afe81"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:04.079113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3c4d25b6-7690-4c30-8e10-b50e9985885d req-873f0076-93b1-4473-986d-e2f2995a7ad1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.080165 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3c4d25b6-7690-4c30-8e10-b50e9985885d req-873f0076-93b1-4473-986d-e2f2995a7ad1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:04.098256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-3c4d25b6-7690-4c30-8e10-b50e9985885d req-873f0076-93b1-4473-986d-e2f2995a7ad1 service nova] Creating event network-vif-plugged:e655642e-a80e-43df-bfde-59c9592afe81 for instance 3dcf398b-babb-4847-a7f6-19219fca641e on hv-cinder-83587 Apr 05 13:44:04.103921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-3c4d25b6-7690-4c30-8e10-b50e9985885d req-873f0076-93b1-4473-986d-e2f2995a7ad1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040272 Apr 05 13:44:04.104859 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 57/107] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:04.325857 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:04.333319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a0877862-08ab-4005-a073-e1f76c3808d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.297547 Apr 05 13:44:04.333988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 51/108] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:04 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:04.505257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-0d43a55f-3024-4304-96cc-1e0c2328885d req-5804cc99-ac07-4900-89c6-0a4379808326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:04.513992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0d43a55f-3024-4304-96cc-1e0c2328885d req-5804cc99-ac07-4900-89c6-0a4379808326 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.514429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0d43a55f-3024-4304-96cc-1e0c2328885d req-5804cc99-ac07-4900-89c6-0a4379808326 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:04.525071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-0d43a55f-3024-4304-96cc-1e0c2328885d req-5804cc99-ac07-4900-89c6-0a4379808326 service nova] Creating event network-changed:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:44:04.530411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-0d43a55f-3024-4304-96cc-1e0c2328885d req-5804cc99-ac07-4900-89c6-0a4379808326 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029073 Apr 05 13:44:04.531252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 58/109] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:04.891584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:04.892588 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:04.900484 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.901793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:04.905042 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:04.905651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:05.053527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:05.061586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-473fd525-967e-4a10-9975-c9d2f1650c0c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.175417 Apr 05 13:44:05.062206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 52/110] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:04 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:05.360806 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:05.362792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:05.371490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:05.372136 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:05.373029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:05.373549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:05.611161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:05.619552 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-119db083-b33d-419b-99ac-43340c318286 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.264762 Apr 05 13:44:05.620127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 59/111] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:05 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:06.092623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:06.093654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:06.103975 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:06.104986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:06.105766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:06.106351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:06.120580 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-860e42d4-d4af-408a-9dce-7e6f5a81c814 req-117589af-56cf-4177-a749-99de746f13f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ef91a-434a-4c31-85d2-c1352a5208f3", "name": "network-vif-plugged", "status": "completed", "tag": "2b817a5d-3997-48f5-8143-c7c5935059ae"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:06.139816 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-860e42d4-d4af-408a-9dce-7e6f5a81c814 req-117589af-56cf-4177-a749-99de746f13f5 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:06.140150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-860e42d4-d4af-408a-9dce-7e6f5a81c814 req-117589af-56cf-4177-a749-99de746f13f5 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:06.155281 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-860e42d4-d4af-408a-9dce-7e6f5a81c814 req-117589af-56cf-4177-a749-99de746f13f5 service nova] Creating event network-vif-plugged:2b817a5d-3997-48f5-8143-c7c5935059ae for instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 on hv-cinder-83587 Apr 05 13:44:06.161506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-860e42d4-d4af-408a-9dce-7e6f5a81c814 req-117589af-56cf-4177-a749-99de746f13f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045260 Apr 05 13:44:06.162551 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 60/112] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:06.484669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:06.491943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b08b4cae-768a-4b03-bd89-17057bb1c266 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.417470 Apr 05 13:44:06.492512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 53/113] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:06 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:06.637896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:06.638627 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:06.644654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:06.645100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:06.645861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:06.646292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:06.780735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:06.787982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3b7d8762-e54e-4ef7-a0ed-47817c28dff3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.155117 Apr 05 13:44:06.788541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 61/114] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:06 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:07.509456 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:07.510120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:07.517012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:07.517468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:07.518227 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:07.518803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:07.647980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:07.655855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-09179d21-7fdb-42c5-9dc4-94a0bab5bf11 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.150257 Apr 05 13:44:07.656430 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 54/115] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:07 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:07.803920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:07.804520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:07.810265 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:07.810713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:07.811465 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:07.811930 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:07.943635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:07.951484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1df4083b-dd3b-4257-98cb-cb74fd314ade tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.151289 Apr 05 13:44:07.952082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 62/116] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:07 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:08.673334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:08.673950 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:08.680312 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:08.680756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:08.681505 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:08.681933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:08.816204 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:08.823654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bc27eb3c-37a5-405a-835a-5f5494f5e2fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.153883 Apr 05 13:44:08.824222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 55/117] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:08 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:08.968837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:08.969449 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:08.975410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:08.975885 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:08.976899 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:08.977327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:09.084176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-31af74cf-9139-453f-b342-d6dfdac1c04c req-ed2fd626-fb12-4d68-8a11-2e547f7bd834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01eed230-0576-46ce-89ed-577fe3bafe14", "name": "network-vif-plugged", "status": "completed", "tag": "5e0130be-6ae6-413d-a3ae-c2ae43b030f9"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:09.094154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-31af74cf-9139-453f-b342-d6dfdac1c04c req-ed2fd626-fb12-4d68-8a11-2e547f7bd834 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:09.094768 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-31af74cf-9139-453f-b342-d6dfdac1c04c req-ed2fd626-fb12-4d68-8a11-2e547f7bd834 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:09.111369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-31af74cf-9139-453f-b342-d6dfdac1c04c req-ed2fd626-fb12-4d68-8a11-2e547f7bd834 service nova] Creating event network-vif-plugged:5e0130be-6ae6-413d-a3ae-c2ae43b030f9 for instance 01eed230-0576-46ce-89ed-577fe3bafe14 on hv-cinder-83587 Apr 05 13:44:09.117387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-31af74cf-9139-453f-b342-d6dfdac1c04c req-ed2fd626-fb12-4d68-8a11-2e547f7bd834 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037482 Apr 05 13:44:09.118558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 56/118] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:09.208735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:09.216839 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b6880335-2aad-4b88-9020-038a9e48a012 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.251957 Apr 05 13:44:09.217710 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 63/119] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:08 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:09.842240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:09.842949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:09.851023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:09.852299 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:09.853718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:09.854999 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:10.012942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:10.020561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5e994d1f-8ac6-4da0-a8a1-66b372cefa8c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.183411 Apr 05 13:44:10.021134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 57/120] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:09 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:10.235163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:10.235782 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:10.241510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:10.241961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:10.242744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:10.243173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:10.716503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:10.727955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-378e6c3a-6535-4fb6-86d1-f407716312d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.496603 Apr 05 13:44:10.728545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 64/121] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:10 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:11.038158 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:11.038785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:11.045949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:11.047245 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:11.048155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:11.052150 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:11.262064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:11.271990 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-48a6958d-91de-4c0b-933c-b257006e11c7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1367 microversion: 2.1 time: 0.237684 Apr 05 13:44:11.279550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 58/122] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:11 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:11.746116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:11.746737 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:11.752658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:11.753099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:11.753856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:11.754284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:11.893670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:11.901334 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b8f41469-611d-4d02-a889-3b8e3f610685 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.158865 Apr 05 13:44:11.901916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 65/123] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:11 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:12.292866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:12.293595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:12.300786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.301236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:12.302012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.302448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:12.455177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:12.463708 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-388a8a01-21b6-418b-8884-60f7a773fe44 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1557 microversion: 2.1 time: 0.175016 Apr 05 13:44:12.464501 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 59/124] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:12 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:12.481749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:12.482386 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:12.491941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.492447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:12.493373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.493914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:12.629332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8644e523-c993-49ef-8ddf-bca602e9492f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151926 Apr 05 13:44:12.629944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 66/125] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:44:12 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:12.919216 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:12.920044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:12.926279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.926844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:12.927746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:12.928291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:13.281072 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:13.290945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fe9e9203-ed9b-46e9-b023-f0f97d6fe523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.377084 Apr 05 13:44:13.292509 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 60/126] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:12 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:13.943510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f81bd601-9ff8-46bb-b9b4-8f8cc71aaf57 req-4b7e28bc-33fa-422a-96aa-9c9b68b77593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcf398b-babb-4847-a7f6-19219fca641e", "tag": "e655642e-a80e-43df-bfde-59c9592afe81"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:13.951641 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f81bd601-9ff8-46bb-b9b4-8f8cc71aaf57 req-4b7e28bc-33fa-422a-96aa-9c9b68b77593 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:13.952091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f81bd601-9ff8-46bb-b9b4-8f8cc71aaf57 req-4b7e28bc-33fa-422a-96aa-9c9b68b77593 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:13.962872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f81bd601-9ff8-46bb-b9b4-8f8cc71aaf57 req-4b7e28bc-33fa-422a-96aa-9c9b68b77593 service nova] Creating event network-changed:e655642e-a80e-43df-bfde-59c9592afe81 for instance 3dcf398b-babb-4847-a7f6-19219fca641e on hv-cinder-83587 Apr 05 13:44:13.970404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f81bd601-9ff8-46bb-b9b4-8f8cc71aaf57 req-4b7e28bc-33fa-422a-96aa-9c9b68b77593 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028805 Apr 05 13:44:13.971048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 67/127] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:14.309214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:14.309852 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:14.316053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:14.316502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:14.317265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:14.317703 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:14.482297 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:14.491681 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7b096dcb-1043-4103-81d1-4acef0afa887 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.186469 Apr 05 13:44:14.492511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 61/128] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:14 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:15.504913 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:15.505499 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:15.508279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:15.508894 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:15.512202 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.512657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.513492 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.513939 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.515440 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.516073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.516903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.517438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.538463 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:44:15.645038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-790ee92a-6f7a-494d-9182-6c9e03fbcf18 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 204 len: 0 microversion: 2.1 time: 0.144176 Apr 05 13:44:15.645640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 68/129] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:44:15 2022] DELETE /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:44:15.654775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:15.655012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:15.660653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.661099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.661849 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:15.662276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:15.678936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:15.686451 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f821eb28-7d42-403b-b423-6f4890efb8b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.182009 Apr 05 13:44:15.687028 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 62/130] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:15 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:15.793914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:15.801618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f2c6d09c-588a-470c-8c96-ff7479666d75 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.151868 Apr 05 13:44:15.802195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 69/131] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:15 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:16.702878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:16.703485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:16.709903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:16.710355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:16.711121 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:16.711589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:16.818315 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:16.818921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:16.825825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:16.826273 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:16.827045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:16.827697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:16.989450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:16.998790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a308e5f-ab0e-45ce-837d-ff13fbbc4160 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.184114 Apr 05 13:44:16.999859 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 70/132] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:16 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:17.048479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:17.056017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1517fdf6-9444-4a85-b264-2c8e251abd0a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.356874 Apr 05 13:44:17.056835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 63/133] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:16 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:18.017422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:18.018023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:18.023808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:18.024252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:18.025001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:18.025429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:18.074855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:18.075383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:18.082555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:18.083284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:18.084328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:18.084765 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:18.164602 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:18.173555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dd31bff1-90ba-489a-9d2b-ac86458d00ce tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.159988 Apr 05 13:44:18.174134 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 71/134] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:18 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:18.224941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:18.233953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9ed6a471-4109-496d-a5ee-8426d17d52cc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.163764 Apr 05 13:44:18.234780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 64/135] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:18 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:19.190770 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:19.191316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:19.196941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:19.197387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:19.198793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:19.199221 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:19.252471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:19.253112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:19.259082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:19.259544 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:19.260986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:19.261417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:19.345380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:19.360436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-47121410-13b4-4171-8aca-718ba27e9aca tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.173568 Apr 05 13:44:19.361024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 72/136] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:19 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:19.399691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:19.406977 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9c3c88a3-e840-4761-8da3-24c9d5039724 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.158871 Apr 05 13:44:19.407564 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 65/137] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:19 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:20.378313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:20.378966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:20.384682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:20.385130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:20.386399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:20.386829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:20.423989 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:20.424681 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:20.430662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:20.431116 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:20.431908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:20.432364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:20.536547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:20.545102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7829c6e7-dd05-4fcf-96c8-1da6c04399d7 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.170619 Apr 05 13:44:20.545774 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 73/138] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:20 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:20.595705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:20.603351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-540ad5c6-d948-4882-b6c0-b4cd90c26f72 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.183187 Apr 05 13:44:20.604122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 66/139] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:20 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:21.562722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:21.563424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:21.569254 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:21.570364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:21.571266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:21.571800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:21.621917 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:21.622698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:21.629657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:21.630978 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:21.632958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:21.633326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:21.722230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:21.731849 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5de3d6c6-f471-4637-aab7-0b0824eb777f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.172942 Apr 05 13:44:21.732570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 74/140] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:21 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:21.790171 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:21.801326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b41afd02-887b-4d8b-b48d-e5b9ead792ef tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.184409 Apr 05 13:44:21.801837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 67/141] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:21 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:22.749188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:22.749791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:22.755456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:22.755933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:22.756681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:22.757107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:22.819741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:22.820352 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:22.827644 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:22.828337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:22.829368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:22.829875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:22.905858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:22.914588 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0f983ecd-5881-42d6-a6ce-a8735faa31a5 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.169883 Apr 05 13:44:22.915314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 75/142] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:22 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:22.997505 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:23.005009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-47723f7e-d676-41fe-a1d0-79ba471bfe8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.189109 Apr 05 13:44:23.005660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 68/143] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:22 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:23.933637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:23.934223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:23.939942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:23.940383 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:23.941286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:23.941719 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:24.022231 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:24.023453 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:24.031214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:24.032879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:24.033827 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:24.034733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:24.105672 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:24.113342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fa43df62-a0c5-44fb-8333-e791a998cf85 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.184217 Apr 05 13:44:24.113908 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 76/144] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:23 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:24.172918 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:24.180620 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e7537b27-2331-4a4f-908f-1f7a379dda56 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1321 microversion: 2.1 time: 0.162289 Apr 05 13:44:24.181189 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 69/145] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:24 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:25.130497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:25.131789 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:25.138569 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.139050 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.139852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.140291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.198890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:25.200185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:25.206807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.207621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.208684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.209363 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.295768 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:25.303692 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8c663353-556e-43d5-80e5-cff563fd8d71 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.177125 Apr 05 13:44:25.304270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 77/146] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:25 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:25.353937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:25.361595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-950d5005-db86-44d3-9090-6d14dd82c7d8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1514 microversion: 2.1 time: 0.167243 Apr 05 13:44:25.362165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 70/147] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:25 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:25.381553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:25.382514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:25.389083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.389517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.390280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.390784 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.413254 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lazy-loading 'flavor' on Instance uuid 01eed230-0576-46ce-89ed-577fe3bafe14 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:44:25.537778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e42305a6-0b27-495e-8633-a659114d58aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14/action" status: 200 len: 32 microversion: 2.1 time: 0.160210 Apr 05 13:44:25.538666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 78/148] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:44:25 2022] POST /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:44:25.550037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:25.551062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:25.557177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.558346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.558950 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:25.559384 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:25.840852 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:25.849835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-37ba1fe7-3206-4fb1-94b2-1135bf26f57c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.303538 Apr 05 13:44:25.860491 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 71/149] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:25 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:26.320948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:26.321779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:26.329070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:26.329596 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:26.330429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:26.330933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:26.481267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:26.489200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8066dc1b-6aee-4363-9e09-c27c886f0f89 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1553 microversion: 2.1 time: 0.172422 Apr 05 13:44:26.489850 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 79/150] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:26 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:26.539689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-6b654560-12fd-46c3-b002-ebd36a2a4e71 req-91a0560d-166e-4ab3-a263-20e9e07e0c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe35196-d7f4-483e-911a-fd38d893ce72", "name": "network-vif-deleted", "tag": "b47f837a-6c09-4dfa-a6fe-b54f99471784"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:26.549055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6b654560-12fd-46c3-b002-ebd36a2a4e71 req-91a0560d-166e-4ab3-a263-20e9e07e0c87 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:26.549610 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6b654560-12fd-46c3-b002-ebd36a2a4e71 req-91a0560d-166e-4ab3-a263-20e9e07e0c87 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:26.562167 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-6b654560-12fd-46c3-b002-ebd36a2a4e71 req-91a0560d-166e-4ab3-a263-20e9e07e0c87 service nova] Creating event network-vif-deleted:b47f837a-6c09-4dfa-a6fe-b54f99471784 for instance cbe35196-d7f4-483e-911a-fd38d893ce72 on hv-cinder-83587 Apr 05 13:44:26.567254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-6b654560-12fd-46c3-b002-ebd36a2a4e71 req-91a0560d-166e-4ab3-a263-20e9e07e0c87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Apr 05 13:44:26.567996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 72/151] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:26.867826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:26.868437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:26.874228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:26.874676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:26.875436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:26.875898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:27.012335 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:27.019666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3aa9b5b9-89ae-47e3-8996-a21b950eca95 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.155693 Apr 05 13:44:27.020248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 80/152] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:26 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:27.506589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:27.507280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:27.514314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:27.514772 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:27.515597 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:27.516057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:27.579368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:27.587342 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f5efba86-b8f2-48ec-a99a-fd69c5202cf0 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1511 microversion: 2.1 time: 0.084886 Apr 05 13:44:27.587961 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 73/153] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:27 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:28.037612 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:28.038253 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:28.045330 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:28.045778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:28.046566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:28.047017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:28.184371 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:28.192169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c285a01f-e146-45db-93d4-13075ad1728b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.158332 Apr 05 13:44:28.192756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 81/154] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:28 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:28.605593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:28.606206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:28.612654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:28.612908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:28.613665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:28.614102 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:28.673755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:28.681528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9dbf9b20-5c19-4f27-983c-281aff366e3f tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1511 microversion: 2.1 time: 0.080600 Apr 05 13:44:28.682100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 74/155] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:28 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1511 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:29.208503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:29.209013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:29.214855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:29.215289 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:29.216157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:29.216588 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:29.363803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:29.370924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d67316e5-c8d7-485a-92a1-dd6a82f19cc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.166283 Apr 05 13:44:29.372129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 82/156] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:29 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:29.698744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:29.699357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:29.705886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:29.706337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:29.707107 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:29.707577 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:29.764713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:29.772265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c954601a-8364-4889-8dbe-05d340db6056 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1511 microversion: 2.1 time: 0.077686 Apr 05 13:44:29.772834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 75/157] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:29 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1511 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:30.389361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:30.389970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:30.396388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:30.396874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:30.397686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:30.398117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:30.540671 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:30.547995 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7dfec090-ce58-4313-94a5-e1a86d9b6d18 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.163417 Apr 05 13:44:30.548565 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 83/158] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:30 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:30.790041 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:30.790616 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:30.797586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:30.798040 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:30.798805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:30.799242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:30.828873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:30.829317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:30.829780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lazy-loading 'fault' on Instance uuid cbe35196-d7f4-483e-911a-fd38d893ce72 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:44:30.873180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89294949f2b14e1f9f3afa03b9e18e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9aa619aa7b4d4d981db173ab77dbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:30.882487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1789b26e-51d6-40ad-b047-2ac9a0b9d6c6 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 200 len: 1351 microversion: 2.1 time: 0.096317 Apr 05 13:44:30.883061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 76/159] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:30 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:31.565304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:31.565941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:31.571773 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:31.572167 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:31.572927 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:31.573361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:31.711999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:31.719374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-26b93594-de8a-43ab-a6b8-dfba45de29ec tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.157859 Apr 05 13:44:31.719997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 84/160] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:31 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:31.899966 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:31.900617 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:31.908104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:31.908561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:31.909327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:31.909833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:31.923805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] HTTP exception thrown: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. Apr 05 13:44:31.924390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Returning 404 to user: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:31.925210 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-24963e3e-579c-44e6-bf6f-cf51de7e6377 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 404 len: 111 microversion: 2.1 time: 0.029667 Apr 05 13:44:31.925734 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 77/161] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:31 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:32.032775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:32.033807 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:32.039795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:32.040240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:32.041010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:32.041439 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:32.055146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] HTTP exception thrown: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. Apr 05 13:44:32.055758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Returning 404 to user: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:32.056580 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1079bb01-1b11-496f-92af-945cae32c612 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027916 Apr 05 13:44:32.057118 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 85/162] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:44:32 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:32.740733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:32.741348 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:32.748390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:32.749391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:32.750182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:32.750618 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:32.893020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:32.911408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-84f580e3-a9c5-4e63-b9de-24db6043e860 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.174317 Apr 05 13:44:32.912712 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 78/163] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:32 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:33.257567 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:33.258131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:33.263930 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.264382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:33.265141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.265584 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:33.279348 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] HTTP exception thrown: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. Apr 05 13:44:33.279967 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Returning 404 to user: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:33.280786 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a23c547d-3dc4-482a-9b42-80c2a6109657 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 404 len: 111 microversion: 2.1 time: 0.027142 Apr 05 13:44:33.281311 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 86/164] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:44:33 2022] DELETE /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:33.289077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:33.289696 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] [instance: cbe35196-d7f4-483e-911a-fd38d893ce72] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:33.296129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.296581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:33.297355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.297795 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:33.311558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] HTTP exception thrown: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. Apr 05 13:44:33.312153 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] Returning 404 to user: Instance cbe35196-d7f4-483e-911a-fd38d893ce72 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:33.313002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a98ff17d-3bed-4df7-9b6e-1f6db4bd7ce1 tempest-DeleteServersTestJSON-740967431 tempest-DeleteServersTestJSON-740967431-project] 10.222.0.59 "GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72" status: 404 len: 111 microversion: 2.1 time: 0.027759 Apr 05 13:44:33.313535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 79/165] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:33 2022] GET /compute/v2.1/servers/cbe35196-d7f4-483e-911a-fd38d893ce72 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:33.930333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:33.931132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:33.937485 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.937937 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:33.938705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:33.939149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:34.076011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:34.083350 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6500b134-dba7-4b5a-92fe-00714e77fb8c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.157025 Apr 05 13:44:34.083970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 87/166] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:33 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:34.968287 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0cb6679d-38fc-4c1f-aa73-f7d2f1429e20 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Action: 'create', calling method: .version_select at 0x7f9bfda381f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1619488547"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:35.100790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:35.101659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:35.108247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:35.108696 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:35.109460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:35.109896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:35.259538 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0cb6679d-38fc-4c1f-aa73-f7d2f1429e20 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.401385 Apr 05 13:44:35.259706 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:35.260154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 80/167] 10.222.0.59 () {60 vars in 1154 bytes} [Tue Apr 5 13:44:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 13:44:35.268355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fe66b3a3-ae38-4fcd-8646-2ec427a751c3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.171320 Apr 05 13:44:35.269562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 88/168] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:35 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:35.273500 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-800689af-661c-4502-9c7e-5d5c85edd212 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfe3240d0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:35.320633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-800689af-661c-4502-9c7e-5d5c85edd212 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 200 len: 345 microversion: 2.1 time: 0.052926 Apr 05 13:44:35.321199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 81/169] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:35 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:36.286061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:36.286705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:36.293312 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:36.293894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:36.294661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:36.295231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:36.333225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8c8c2172-0dab-4dd6-8052-2580058448d0 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfda9b790>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:36.380210 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8c8c2172-0dab-4dd6-8052-2580058448d0 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 200 len: 345 microversion: 2.1 time: 0.051091 Apr 05 13:44:36.381012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 82/170] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:36 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:36.428753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:36.436281 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-de99ba50-b454-408a-a42a-8c3a04ac0fbe tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.154041 Apr 05 13:44:36.436861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 89/171] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:36 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:37.392402 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62383fa6-8a85-43ef-80a8-7c2ef995e587 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfd9ee790>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:37.438316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-62383fa6-8a85-43ef-80a8-7c2ef995e587 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 200 len: 346 microversion: 2.1 time: 0.050121 Apr 05 13:44:37.438876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 83/172] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:37 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:37.449826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9d3accda-2142-4003-a232-c2b67f9c7288 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Action: 'create', calling method: .version_select at 0x7f9bfdacc940>, body: {"snapshot": {"volume_id": "001b6156-c896-4a0c-a855-e1829042b4f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-624029714"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:44:37.453617 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:37.454221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:37.460631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:37.461084 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:37.461842 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:37.462304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:37.593400 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:37.598306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9d3accda-2142-4003-a232-c2b67f9c7288 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152369 Apr 05 13:44:37.599006 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 90/173] 10.222.0.59 () {60 vars in 1161 bytes} [Tue Apr 5 13:44:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:37.601146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3e8eaab6-dc79-4dc3-aeea-1f094f458750 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.151998 Apr 05 13:44:37.602129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 84/174] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:37 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:37.609915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-095ed11b-f86f-4dd1-af6f-e84958f88434 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdacc700>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:37.644436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-095ed11b-f86f-4dd1-af6f-e84958f88434 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.037972 Apr 05 13:44:37.645110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 91/175] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:37 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:37.655665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-820649a9-dafc-4c8e-96e4-01079400f385 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bff5a1dc0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:37.715419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-820649a9-dafc-4c8e-96e4-01079400f385 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.064599 Apr 05 13:44:37.716202 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 85/176] 10.222.0.59 () {58 vars in 1139 bytes} [Tue Apr 5 13:44:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:37.726787 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e868d4cb-c289-4ff9-a015-f11b1356c261 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfd9aa160>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:37.755766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e868d4cb-c289-4ff9-a015-f11b1356c261 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.032788 Apr 05 13:44:37.760049 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 92/177] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:37 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:38.618506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:38.619139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:38.625807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:38.626255 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:38.627050 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:38.627479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:38.758187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:38.766411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1466f1c4-e6b5-4e06-9d90-20f4ac4aa4f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.152199 Apr 05 13:44:38.766974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 86/178] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:38 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:38.768060 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-85023687-98b4-4598-803a-f15825087d31 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdb0ec10>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:38.796180 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-85023687-98b4-4598-803a-f15825087d31 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.031919 Apr 05 13:44:38.796744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 93/179] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:38 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:39.783859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:39.784820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:39.792120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:39.792550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:39.793529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:39.793974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:39.807637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3f562682-29f7-4b31-a7f1-b4a14cab4cf4 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdacc550>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:39.839327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3f562682-29f7-4b31-a7f1-b4a14cab4cf4 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.035507 Apr 05 13:44:39.844288 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 94/180] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:39 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:39.954893 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:39.963454 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-da5c27ac-b233-4487-8339-0a7f0e8ecd59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.184034 Apr 05 13:44:39.970000 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 87/181] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:39 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:40.857020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-531b490e-3874-4aed-a8c0-75d86124ea81 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdaccf70>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:40.882247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-531b490e-3874-4aed-a8c0-75d86124ea81 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.034275 Apr 05 13:44:40.882856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 95/182] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:40 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:40.982357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:40.983118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:40.989630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:40.990086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:40.990859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:40.991297 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:41.131229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:41.138953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-12368621-c3e9-4d6a-b86d-04925864e702 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.161668 Apr 05 13:44:41.139547 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 88/183] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:40 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:41.894785 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a7a030aa-1bbd-4892-961d-7f0751dce95e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdb1f670>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:41.925696 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a7a030aa-1bbd-4892-961d-7f0751dce95e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 287 microversion: 2.1 time: 0.034737 Apr 05 13:44:41.926437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 96/184] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:41 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:41.939095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a3ff874c-6e9f-4f88-87fb-1779802cbb2b tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfda9bca0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:41.998165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a3ff874c-6e9f-4f88-87fb-1779802cbb2b tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 202 len: 0 microversion: 2.1 time: 0.064738 Apr 05 13:44:42.001940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 89/185] 10.222.0.59 () {58 vars in 1253 bytes} [Tue Apr 5 13:44:41 2022] DELETE /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:44:42.006722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d1b7b70f-3927-45f6-8126-2d92675812e9 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdb1f1f0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:42.035851 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d1b7b70f-3927-45f6-8126-2d92675812e9 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 200 len: 286 microversion: 2.1 time: 0.032841 Apr 05 13:44:42.036489 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 97/186] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:42 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:44:42.156227 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:42.156845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:42.163260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:42.163737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:42.164499 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:42.165147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:42.374091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:42.393322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5a47bbc1-3189-4d16-9326-76c5483e6b77 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.241186 Apr 05 13:44:42.393817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 90/187] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:42 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:43.047825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e8936d20-86ff-43c9-93a4-b5393476ea9e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdaccaf0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:43.072215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-e8936d20-86ff-43c9-93a4-b5393476ea9e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] HTTP exception thrown: Snapshot d3ccbedc-d553-4002-98b6-37ad67075666 could not be found. Apr 05 13:44:43.072810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e8936d20-86ff-43c9-93a4-b5393476ea9e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Returning 404 to user: Snapshot d3ccbedc-d553-4002-98b6-37ad67075666 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:43.073635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e8936d20-86ff-43c9-93a4-b5393476ea9e tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666" status: 404 len: 111 microversion: 2.1 time: 0.030409 Apr 05 13:44:43.074172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 98/188] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Apr 5 13:44:43 2022] GET /compute/v2.1/os-snapshots/d3ccbedc-d553-4002-98b6-37ad67075666 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:43.083671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8657b3d6-1656-4ca5-acc6-838b585e081a tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfda1a3a0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:43.150854 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8657b3d6-1656-4ca5-acc6-838b585e081a tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 202 len: 0 microversion: 2.1 time: 0.072324 Apr 05 13:44:43.151524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 91/189] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:44:43 2022] DELETE /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:44:43.160879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-74e868a5-15d3-4d74-b154-dac99338511b tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdb74700>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:43.211327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-74e868a5-15d3-4d74-b154-dac99338511b tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 200 len: 345 microversion: 2.1 time: 0.054313 Apr 05 13:44:43.212377 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 99/190] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:43 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:44:43.412813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:43.412813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:43.418648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:43.420424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:43.421418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:43.421858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:43.578323 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:43.586446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d6096866-c558-40f2-ad4b-ce2dacc55bf7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.178690 Apr 05 13:44:43.592093 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 92/191] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:43 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:44.227949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fcef17eb-2ad3-4ba7-9200-e79a28dafefd tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdacc9d0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:44.254240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-fcef17eb-2ad3-4ba7-9200-e79a28dafefd tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] HTTP exception thrown: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. Apr 05 13:44:44.254976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fcef17eb-2ad3-4ba7-9200-e79a28dafefd tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Returning 404 to user: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:44.255829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fcef17eb-2ad3-4ba7-9200-e79a28dafefd tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 404 len: 109 microversion: 2.1 time: 0.031969 Apr 05 13:44:44.256373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 100/192] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:44 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:44.271071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62983d8a-2a67-4b74-a51a-27cf0d6f8d48 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfd9ee5e0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:44.299777 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-62983d8a-2a67-4b74-a51a-27cf0d6f8d48 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] HTTP exception thrown: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. Apr 05 13:44:44.300408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62983d8a-2a67-4b74-a51a-27cf0d6f8d48 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Returning 404 to user: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:44.301221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-62983d8a-2a67-4b74-a51a-27cf0d6f8d48 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 404 len: 109 microversion: 2.1 time: 0.034004 Apr 05 13:44:44.301892 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 93/193] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:44:44 2022] DELETE /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:44:44.309917 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1658e40f-2f5b-4999-8c44-165d4dd656a7 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Calling method '.version_select at 0x7f9bfdb0ee50>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:44.339178 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-1658e40f-2f5b-4999-8c44-165d4dd656a7 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] HTTP exception thrown: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. Apr 05 13:44:44.339803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1658e40f-2f5b-4999-8c44-165d4dd656a7 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] Returning 404 to user: Volume 001b6156-c896-4a0c-a855-e1829042b4f5 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:44:44.340636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1658e40f-2f5b-4999-8c44-165d4dd656a7 tempest-VolumesSnapshotsTestJSON-434082478 tempest-VolumesSnapshotsTestJSON-434082478-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5" status: 404 len: 109 microversion: 2.1 time: 0.034691 Apr 05 13:44:44.342030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 101/194] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:44:44 2022] GET /compute/v2.1/os-volumes/001b6156-c896-4a0c-a855-e1829042b4f5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:44:44.605531 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:44.606147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:44.613874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:44.614329 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:44.615136 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:44.615628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:44.745590 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:44.754695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bd15101a-58ee-4814-8fb6-e2445ade6740 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.153092 Apr 05 13:44:44.755272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 94/195] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:44 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:45.772244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:45.772843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:45.779248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:45.779825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:45.780466 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:45.780897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:45.923423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:45.930724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0eccb84d-1271-49a2-8f2c-c87bb1a8ad59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.162206 Apr 05 13:44:45.931253 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 102/196] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:45 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:46.947609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:46.948244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:46.954993 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:46.955437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:46.956235 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:46.956667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:47.087630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:47.095293 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f7de778a-2353-4183-b08b-c8e62981ec81 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.151588 Apr 05 13:44:47.095890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 95/197] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:46 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:48.112613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:48.113223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:48.119091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:48.119571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:48.120332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:48.120765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:48.256191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:48.264131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-49a3c8a0-fc7c-42fc-aead-f5ded9422969 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.155250 Apr 05 13:44:48.264700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 103/198] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:48 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:49.282416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:49.283028 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:49.289678 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:49.290223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:49.291064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:49.291587 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:49.436035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:49.442800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d3a8d9f1-5e90-4da2-921e-2bd41759f97a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.165727 Apr 05 13:44:49.443360 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 96/199] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:49 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:50.460308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:50.461506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:50.472227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:50.472681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:50.473766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:50.474291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:50.617492 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:50.627595 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5c0442da-9d5a-47f9-a149-2a5b56d86d4a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.170776 Apr 05 13:44:50.628138 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 104/200] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:50 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:51.644688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:51.645286 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:51.651564 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:51.652017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:51.652773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:51.653722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:51.816861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:51.824104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-93dc85af-df15-4933-8284-3d85d54eb8bc tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.183275 Apr 05 13:44:51.824842 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 97/201] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:51 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:52.848758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:52.849154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:52.861731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:52.862181 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:52.863016 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:52.863451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:53.056179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:53.065800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7bf9b53a-48bd-4855-b2ce-2de2c4120b3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.226492 Apr 05 13:44:53.075754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 105/202] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:52 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:54.082624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:54.083236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:54.089710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:54.090166 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:54.091541 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:54.091980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:54.233911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:54.242346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0450694b-d52d-479d-ac49-275ed1c83e89 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.163603 Apr 05 13:44:54.242923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 98/203] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:54 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:55.258540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:55.259140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:55.265734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:55.266176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:55.266927 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:55.267359 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:55.399590 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:55.407147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-46c113b9-1366-41d3-b1a6-f8030c0bc94a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.152339 Apr 05 13:44:55.407753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 106/204] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:55 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:56.424144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:56.424756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:56.431161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:56.431642 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:56.432409 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:56.432846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:56.574227 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:56.582386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8fe6e6db-92d0-445b-9775-3918d0b646c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.162106 Apr 05 13:44:56.582951 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 99/205] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:56 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:44:57.599637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:57.600257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:57.607405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:57.607915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:57.609245 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:57.609681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:57.746576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:57.754233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7f4774ec-56b0-4277-b2c5-e02cb34d8e2a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.158577 Apr 05 13:44:57.754812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 107/206] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:57 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:44:58.772083 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:44:58.772699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:44:58.779295 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:58.779774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:58.780574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:44:58.781006 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:44:59.012887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:44:59.025073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7270dd48-51da-43c0-907a-214882c15508 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.256938 Apr 05 13:44:59.025869 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 100/207] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:44:58 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:00.043598 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:00.044477 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:00.050920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:00.052108 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:00.052997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:00.053497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:00.210861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:00.218792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-064797ab-83ed-4c40-aea7-aa6a28c2530d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.179063 Apr 05 13:45:00.219388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 108/208] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:00 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:01.257507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:01.258127 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:01.264917 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:01.265373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:01.266396 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:01.266976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:01.436963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:01.446090 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f8ac4a7a-2ab4-44ea-8982-c9b30b70e758 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.210594 Apr 05 13:45:01.446999 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 101/209] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:01 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:02.464885 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:02.465620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:02.471657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:02.472282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:02.473159 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:02.473906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:02.686893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:02.695781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fe359b74-12d1-408b-9c89-d2e9b2241376 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.234496 Apr 05 13:45:02.696105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 109/210] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:02 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:03.723698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:03.724325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:03.732885 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:03.733339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:03.734119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:03.734554 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:03.933405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:03.942260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7c44aa92-946e-4563-840d-e463a0057aac tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.232539 Apr 05 13:45:03.943485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 102/211] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:03 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:04.047049 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-973316766", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:04.100258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] validate_networks() for None {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:45:04.383826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:45:04.384314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:45:04.384855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:45:04.385269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:45:04.385678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:45:04.395207 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:04.395703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:04.396495 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:04.396928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:04.413688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Getting quotas for project 65f5c39f4b3b4c7b9c60694c4f8602fb. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:04.417443 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Getting quotas for user 59460118ca8c42709449ba599025dc7a and project 65f5c39f4b3b4c7b9c60694c4f8602fb. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:04.428729 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:45:04.431019 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:45:04.478057 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0e343644-29a6-4a16-9d3d-2fd5fea2f510 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435549 Apr 05 13:45:04.478839 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 110/212] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:45:04.488865 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5fca45c0-9860-4056-a7a9-850eb8883d80 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:04.489487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5fca45c0-9860-4056-a7a9-850eb8883d80 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:04.543696 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5fca45c0-9860-4056-a7a9-850eb8883d80 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:04.550956 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5fca45c0-9860-4056-a7a9-850eb8883d80 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1214 microversion: 2.1 time: 0.065961 Apr 05 13:45:04.555588 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 103/213] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:04 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:04.961460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:04.962201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:04.968897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:04.969344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:04.970109 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:04.970545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:05.200468 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:05.208504 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-07d9d66f-5858-4766-9af0-53ecf3ba5c59 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.250966 Apr 05 13:45:05.219843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 111/214] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:04 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:05.568209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:05.569460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:05.577172 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:05.577744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:05.578624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:05.579267 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:05.647845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:05.655257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cbabd179-0e69-42cf-9f84-b18da0e5445b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1218 microversion: 2.1 time: 0.091264 Apr 05 13:45:05.655947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 104/215] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:05 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:06.226608 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:06.227324 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:06.234286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:06.234688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:06.235745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:06.236182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:06.438169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:06.452479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dfdc2835-b001-4016-aa7b-ada57660ec8b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.230110 Apr 05 13:45:06.453073 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 112/216] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:06 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:06.672660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:06.673263 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:06.679451 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:06.679930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:06.680689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:06.681122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:06.760927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:06.769214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0178356f-a5c4-429b-b8ef-20b0d0c6a77d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1218 microversion: 2.1 time: 0.100990 Apr 05 13:45:06.772798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 105/217] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:06 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:07.486929 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:07.488036 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:07.499809 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:07.502138 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:07.505190 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:07.507782 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:07.739093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:07.763829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-720331ad-8a50-4392-a914-2b512fe6d04a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.282853 Apr 05 13:45:07.775171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 113/218] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:07 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:07.789328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:07.789931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:07.798237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:07.798689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:07.799452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:07.799911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:07.974570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:07.993299 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a3627cf2-d3cb-4dcd-b70e-c2446c92cfb9 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1266 microversion: 2.1 time: 0.203948 Apr 05 13:45:08.006001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 106/219] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:07 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:08.783405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:08.784080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:08.791024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:08.808322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:08.811418 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:08.815438 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:09.011076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:09.011736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:09.025232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:09.027809 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:09.029670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:09.032117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:09.183272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:09.192789 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c8ab84a4-029b-4109-9e8e-2c75435c5f98 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.413049 Apr 05 13:45:09.201506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 114/220] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:08 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:09.276879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:09.287528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9401f289-e92f-49b7-8e5b-90768021ab2d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1272 microversion: 2.1 time: 0.280018 Apr 05 13:45:09.289127 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 107/221] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:09 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:10.210468 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:10.211090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:10.218889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:10.219404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:10.220475 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:10.220662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:10.307437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:10.309012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:10.331072 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:10.332653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:10.333897 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:10.334566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:10.437278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:10.452233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-59bb7a67-62d5-4163-ab8d-67d8651c322a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.245187 Apr 05 13:45:10.461953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 115/222] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:10 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:10.793638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:10.810540 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-855ba73b-4620-4e75-824a-13a36b7d925b tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.506846 Apr 05 13:45:10.815542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 108/223] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:10 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:11.470075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:11.470683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:11.482412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:11.482897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:11.483884 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:11.485219 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:11.828146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:11.829055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:11.830450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:11.848849 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:11.853126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:11.853126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:11.853723 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-04a9730a-0738-48ef-a138-f9f1ca7348ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.382965 Apr 05 13:45:11.853843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:11.854154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 116/224] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:11 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:11.919196 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-ad23f17a-d072-4157-ac86-a4b68df50eb6 req-1a3a20de-bcd2-4175-b55a-032972db1f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60c0c63-a765-43bd-bcf4-357ae6918949", "tag": "47eba8e4-9b49-4c55-9948-b72eb9a93876"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:11.938944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ad23f17a-d072-4157-ac86-a4b68df50eb6 req-1a3a20de-bcd2-4175-b55a-032972db1f0c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:11.942388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ad23f17a-d072-4157-ac86-a4b68df50eb6 req-1a3a20de-bcd2-4175-b55a-032972db1f0c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:11.964526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-ad23f17a-d072-4157-ac86-a4b68df50eb6 req-1a3a20de-bcd2-4175-b55a-032972db1f0c service nova] Creating event network-changed:47eba8e4-9b49-4c55-9948-b72eb9a93876 for instance d60c0c63-a765-43bd-bcf4-357ae6918949 on hv-cinder-83587 Apr 05 13:45:11.980445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-ad23f17a-d072-4157-ac86-a4b68df50eb6 req-1a3a20de-bcd2-4175-b55a-032972db1f0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067266 Apr 05 13:45:11.984948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 117/225] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:45:12.094223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:12.107025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a094ab9f-3d6d-49cc-ae96-7e2325eb2f0c tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.284030 Apr 05 13:45:12.117243 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 109/226] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:11 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:12.802532 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:12.803765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:12.819429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:12.825528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:12.831248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:12.832299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:12.870256 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:12.871007 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:12.898079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:12.898830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:12.904493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:12.906940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:12.962793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ca1fc6b2-dc36-4c9b-bc69-12d30a28401d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/ips" status: 200 len: 152 microversion: 2.20 time: 0.165101 Apr 05 13:45:12.969173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 118/227] 10.222.0.59 () {60 vars in 1288 bytes} [Tue Apr 5 13:45:12 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/ips => generated 152 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:45:13.132891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:13.139344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:13.167618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:13.169751 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:13.172818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:13.178800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:13.800243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:13.815288 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8330fc13-9635-4c0c-a7a9-ff007d62fad4 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.686453 Apr 05 13:45:13.825203 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 119/228] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:13 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:13.998317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:14.015136 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dbb51b55-663d-4fbd-a29f-a19f34a392d6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 1.148620 Apr 05 13:45:14.016858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 110/229] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:12 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:14.832333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:14.833494 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:14.848456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:14.849076 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:14.849921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:14.850362 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:15.034369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:15.035582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:15.050998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:15.051641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:15.052731 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:15.053668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:15.190916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:15.203882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2ab4c45c-4e81-436d-a9bc-0e65d62b6b5e tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.375224 Apr 05 13:45:15.204478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 120/230] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:14 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:15.450224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:15.450838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:15.462467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:15.463188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:15.466420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:15.467013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:15.516555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lazy-loading 'flavor' on Instance uuid e37a50af-47fc-4de4-a209-8116bed7038d {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:45:15.649894 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:15.664499 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d479c7e0-63dc-4a27-a6f9-477e56cdf523 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1520 microversion: 2.1 time: 0.634301 Apr 05 13:45:15.665156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 111/231] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:15 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:16.013595 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cb1adf60-288b-4239-8640-2d48ac29603c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/action" status: 202 len: 0 microversion: 2.20 time: 0.567356 Apr 05 13:45:16.018681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 121/232] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Apr 5 13:45:15 2022] POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:45:16.028407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:16.029249 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:16.048626 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.049269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:16.049926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.050384 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:16.224567 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:16.225325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:16.251224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.254566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:16.256564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.258220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:16.361248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:16.373065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:16.378510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:16.380705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3046ae47-17c5-4164-a58e-3b79fd575b73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.359477 Apr 05 13:45:16.409001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 112/233] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:16 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:16.672023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:16.682384 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cf1ece3b-253c-4d27-9279-ae67039cdd6d tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.464700 Apr 05 13:45:16.686202 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 122/234] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:16 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:16.700885 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:16.704369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:16.718940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.719697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:16.722170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:16.723076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.077385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:17.089204 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cebd0d60-3762-431b-8d2f-05760ce11cf6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1500 microversion: 2.1 time: 0.398372 Apr 05 13:45:17.091608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 113/235] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:16 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1500 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:17.111595 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:17.112422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:17.150410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.151113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.152183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.155030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.418997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:17.419899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:17.430374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.434275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.435530 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.439422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.808912 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:17.817374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-45e042ce-2f67-4b83-a488-ca5da7929878 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1515 microversion: 2.1 time: 0.713758 Apr 05 13:45:17.829846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 123/236] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:17 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1515 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:17.835392 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:17.836228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:17.852246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.857312 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:17.862922 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:17.864311 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:18.171018 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:18.172590 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:18.188313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a7b959bd-3f8b-40d4-b84c-2acccd786175 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.358132 Apr 05 13:45:18.188313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 124/237] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:17 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:18.190749 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:18.194253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:18.195459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-31def669-69c4-4075-bc9f-b58f13bd35e6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.781658 Apr 05 13:45:18.198817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 114/238] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:17 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:19.212692 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:19.216541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:19.218803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:19.219270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:19.225201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:19.225650 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:19.226680 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:19.228046 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:19.228674 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:19.229617 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:19.230206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:19.233381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:19.482526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:19.492593 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d899d0af-b99d-46e4-92a7-ff59104c27a5 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.289348 Apr 05 13:45:19.493150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 125/239] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:19 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:19.748534 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:19.764188 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:19.768192 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:19.773967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-def44807-4f21-4d19-b794-042af84dcacc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.556434 Apr 05 13:45:19.775439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 115/240] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:19 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:45:20.509586 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:20.510352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:20.543835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:20.549949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:20.550884 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:20.555993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:20.794276 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:20.796298 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:20.818446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:20.828788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:20.830737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:20.832984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:20.956121 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:20.981496 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9f45afe0-64f4-4590-a0fa-9d870f7f2428 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.475505 Apr 05 13:45:20.983062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 126/241] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:20 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:20.996554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:21.016003 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:21.033697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.034160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.036930 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.037440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.113262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lazy-loading 'flavor' on Instance uuid ec3ef91a-434a-4c31-85d2-c1352a5208f3 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:45:21.206966 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:21.216614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:21.222848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:21.229372 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-42f98ac8-8512-4a81-ae99-c6b0bd11056b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.440444 Apr 05 13:45:21.241449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 116/242] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:20 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:21.328738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fcda5f1f-482b-41d8-a3da-ac9bd20aaa1d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/action" status: 200 len: 32 microversion: 2.1 time: 0.343820 Apr 05 13:45:21.331956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 127/243] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:45:20 2022] POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:45:21.344184 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:21.347837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:21.360739 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.361519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.362638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.363384 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.739982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:21.740561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:21.763833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.764292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.765099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:21.765534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:21.870780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77b09f89-fcdd-40c9-bcd4-20f84102d45a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/ips" status: 200 len: 149 microversion: 2.1 time: 0.132492 Apr 05 13:45:21.874944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 128/244] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:45:21 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:45:21.999783 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:22.000527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:22.010939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:22.016269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:22.016745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:22.019270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:22.021223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:22.029476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2c266604-686b-4130-8cc2-e3d910b63c28 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.690926 Apr 05 13:45:22.033043 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 117/245] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:21 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:22.252111 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:22.253085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:22.253694 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:22.264580 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a2c7ff51-3477-496e-9847-4afbe24a7364 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.270021 Apr 05 13:45:22.273637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 129/246] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:21 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:22.274232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:22.278659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:22.279706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:22.280155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:22.758389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-39f117db-f6af-4e3e-b0a0-cb9fc900d174 req-8b5f8896-fa34-4ee0-874d-2b90da0551ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60c0c63-a765-43bd-bcf4-357ae6918949", "name": "network-vif-plugged", "status": "completed", "tag": "47eba8e4-9b49-4c55-9948-b72eb9a93876"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:22.786422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-39f117db-f6af-4e3e-b0a0-cb9fc900d174 req-8b5f8896-fa34-4ee0-874d-2b90da0551ad service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:22.786896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-39f117db-f6af-4e3e-b0a0-cb9fc900d174 req-8b5f8896-fa34-4ee0-874d-2b90da0551ad service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:22.836266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:22.844190 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-39f117db-f6af-4e3e-b0a0-cb9fc900d174 req-8b5f8896-fa34-4ee0-874d-2b90da0551ad service nova] Creating event network-vif-plugged:47eba8e4-9b49-4c55-9948-b72eb9a93876 for instance d60c0c63-a765-43bd-bcf4-357ae6918949 on hv-cinder-83587 Apr 05 13:45:22.852848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:22.860893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-39f117db-f6af-4e3e-b0a0-cb9fc900d174 req-8b5f8896-fa34-4ee0-874d-2b90da0551ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107575 Apr 05 13:45:22.862032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 130/247] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:45:22.862955 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:22.864199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a7d82ef5-c50d-435b-839a-81d2fc848072 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.619087 Apr 05 13:45:22.864757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 118/248] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:22 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:45:23.050999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:23.051895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:23.069009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.069866 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.074983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.075793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.285009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:23.285630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:23.297318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.297634 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.298421 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.298856 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.379235 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:23.393636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-56f2df3b-408d-48d2-9034-d5bace405ca3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.347176 Apr 05 13:45:23.395708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 131/249] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:23 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:23.539947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:23.552582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-676bec17-c466-4de3-bee8-8032554069da tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.272171 Apr 05 13:45:23.570025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 119/250] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:23 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:23.798314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "643961cd-3214-4523-af9b-da15269215d1"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:23.800451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:23.816410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.829262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.830106 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.830547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.885147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:23.885748 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:23.899450 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.904203 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:23.905271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:23.905717 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:24.188851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:24.202479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:24.222959 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:24.228239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-852ea048-9dd6-415f-9508-d4ab158ee813 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.348525 Apr 05 13:45:24.232089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 120/251] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:23 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:24.413992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:24.434764 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:24.468991 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:24.471170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:24.483176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:24.487000 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:24.520616 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-32b62421-1678-4aa2-9c58-e3b546113cac tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722009 Apr 05 13:45:24.534176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 132/252] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:45:23 2022] POST /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:45:24.586246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:24.587488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:24.613918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:24.620669 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:24.626201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:24.628121 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:24.946350 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:24.987381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9fd5156c-b4d6-46f6-8dac-30e97c7ee6c1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.559482 Apr 05 13:45:24.989728 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 121/253] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:24 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:25.102559 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:25.120039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9a9a69f8-0720-4413-8f10-f457018f3ea6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1314 microversion: 2.1 time: 0.536401 Apr 05 13:45:25.120676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 133/254] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:24 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:25.250628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:25.251365 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:25.263153 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:25.264191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:25.265593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:25.268633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:25.595419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:25.615403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:25.631134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:25.636185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-045b8f8e-ded6-44f5-abbb-13093f6c7b46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.390644 Apr 05 13:45:25.638690 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 122/255] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:25 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:26.006398 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:26.008576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:26.023860 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.024646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.025808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.026668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.143144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:26.144293 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:26.173923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.175100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.187167 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.190185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.421747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:26.430823 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bfdc91ef-4fa7-482c-af13-d2ae319e213d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.429690 Apr 05 13:45:26.440368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 134/256] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:25 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:26.600915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:26.614259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f389f8ab-f163-405f-a910-ec20293c85e6 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1463 microversion: 2.1 time: 0.481146 Apr 05 13:45:26.635911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 123/257] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:26 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1463 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:26.656862 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:26.658112 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:26.670589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.672039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.674561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.676535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.695013 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:26.695813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:26.707793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.712365 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.713405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:26.714030 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:26.791269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:45:27.094302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a3f2a291-3925-41f5-83a2-ab14a7b58c68 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 204 len: 0 microversion: 2.1 time: 0.397112 Apr 05 13:45:27.095721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 124/258] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:45:26 2022] DELETE /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:45:27.110165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:27.116600 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:27.134727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:27.138929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:27.144035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:27.145543 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:27.169919 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:27.184622 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:27.190575 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:27.196617 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b4dc213d-9981-43f1-9260-21489a67f424 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.543429 Apr 05 13:45:27.197217 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 135/259] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:26 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:27.432806 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:27.441954 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-72c3d6b2-38ce-4bab-b269-8ec46991e450 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1469 microversion: 2.1 time: 0.341582 Apr 05 13:45:27.451790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:27.453072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:27.463379 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:27.474275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 125/260] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:27 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:27.474740 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:27.476631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:27.477277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:27.672073 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:27.683346 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f3945202-3f58-4978-bd52-a86b211ad899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.236979 Apr 05 13:45:27.684842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 136/261] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:27 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:28.219741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:28.220346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:28.233288 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.233746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.234537 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.236786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.483559 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:28.484872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:28.491722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:28.500908 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.501678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.502376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:28.503695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.504368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.509291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:28.510998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d94fd17a-40f6-48e3-a7f0-1d34f85e904b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.296731 Apr 05 13:45:28.512808 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 126/262] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:28 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:28.702850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:28.703848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:28.716198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.718417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.719476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:28.729321 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:28.885806 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:28.899027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b3184598-b28a-4657-a353-e89d11a28044 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1469 microversion: 2.1 time: 0.417877 Apr 05 13:45:28.899708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 137/263] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:28 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:29.418374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:29.426119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1331c18e-fb19-4469-b085-f082f6641599 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.727741 Apr 05 13:45:29.426715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 127/264] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:28 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:29.530855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:29.532095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:29.545247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:29.545889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:29.546687 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:29.547141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:29.834488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:29.862364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:29.871708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:29.874538 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bbb0cfd3-c083-4d10-a9fe-f7d626a5ea1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.348208 Apr 05 13:45:29.875135 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 138/265] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:29 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:29.928378 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:29.929478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:29.938907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:29.939371 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:29.940238 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:29.940678 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:30.014684 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-8f67f0a0-23c1-4e52-b253-e6df865cdf38 req-eb70d67b-817f-4505-9eaa-66adff749aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60c0c63-a765-43bd-bcf4-357ae6918949", "name": "network-vif-deleted", "tag": "47eba8e4-9b49-4c55-9948-b72eb9a93876"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:30.032502 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8f67f0a0-23c1-4e52-b253-e6df865cdf38 req-eb70d67b-817f-4505-9eaa-66adff749aba service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:30.034263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8f67f0a0-23c1-4e52-b253-e6df865cdf38 req-eb70d67b-817f-4505-9eaa-66adff749aba service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:30.053895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-8f67f0a0-23c1-4e52-b253-e6df865cdf38 req-eb70d67b-817f-4505-9eaa-66adff749aba service nova] Creating event network-vif-deleted:47eba8e4-9b49-4c55-9948-b72eb9a93876 for instance d60c0c63-a765-43bd-bcf4-357ae6918949 on hv-cinder-83587 Apr 05 13:45:30.060901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-8f67f0a0-23c1-4e52-b253-e6df865cdf38 req-eb70d67b-817f-4505-9eaa-66adff749aba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052916 Apr 05 13:45:30.062216 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 139/266] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:45:30.081086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59460118ca8c42709449ba599025dc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f5c39f4b3b4c7b9c60694c4f8602fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:30.106250 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-65f4ebb0-638b-40a4-88e1-dab1ff0ac5f7 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 200 len: 1427 microversion: 2.1 time: 0.191397 Apr 05 13:45:30.109437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 128/267] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:29 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:30.448852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:30.450301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:30.459764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:30.460683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:30.461886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:30.462472 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:30.860925 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:30.869280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-518f8a8f-ea5a-44da-9661-fbad9f22e30e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.427837 Apr 05 13:45:30.873234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 140/268] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:30 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:30.899048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:30.902585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:30.918854 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:30.919326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:30.920187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:30.921266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:31.127708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:31.128761 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] [instance: d60c0c63-a765-43bd-bcf4-357ae6918949] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:31.135665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:31.136518 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:31.137944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:31.138620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:31.156529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] HTTP exception thrown: Instance d60c0c63-a765-43bd-bcf4-357ae6918949 could not be found. Apr 05 13:45:31.157570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] Returning 404 to user: Instance d60c0c63-a765-43bd-bcf4-357ae6918949 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:45:31.158687 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8d52a6bc-f3b4-4770-be3b-b84c04ad8a41 tempest-VolumesNegativeTest-1270735368 tempest-VolumesNegativeTest-1270735368-project] 10.222.0.59 "GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949" status: 404 len: 111 microversion: 2.1 time: 0.035760 Apr 05 13:45:31.164933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 141/269] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:31 2022] GET /compute/v2.1/servers/d60c0c63-a765-43bd-bcf4-357ae6918949 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:45:31.224601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:31.237849 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:31.240844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:31.245184 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-17ea153b-33e1-44ee-a03d-6fec22d39da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.352001 Apr 05 13:45:31.247676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 129/270] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:30 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:31.891909 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:31.893977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:31.903119 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:31.904185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:31.905125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:31.905712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:32.154525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:32.165087 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9b45e34e-0626-4664-a58a-686650adc7a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.278880 Apr 05 13:45:32.165922 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 142/271] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:31 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:32.267784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:32.268403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:32.289087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:32.292476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:32.293908 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:32.303659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:32.609302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:32.618889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:32.624654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:32.625859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-099949ed-7988-4404-8966-fa91c478861c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.362816 Apr 05 13:45:32.627818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 130/272] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:32 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:32.871874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: .version_select at 0x7f9bfd935b80>, body: {"keypair": {"name": "tempest-keypair-2097392087"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:32.888687 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:32.893724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:33.139801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:33.143778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:33.166805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2243d2ef-2f8a-473b-8479-6aa00d95742f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.299260 Apr 05 13:45:33.174141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 143/273] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:45:32 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:33.182385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:33.183005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:33.195294 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:33.196339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:33.199723 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:33.202551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:33.549355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:33.559841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-454588cf-c071-46f5-a71d-1e6ec9d28f52 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.380905 Apr 05 13:45:33.569488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 131/274] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:33 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:33.647105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:33.648089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:33.658110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:33.660408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:33.661431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:33.665592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:33.969174 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:33.983172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:33.987336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:33.988578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a6143cec-6069-4810-97d4-8831de1514df tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.345796 Apr 05 13:45:33.997675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 144/275] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:33 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:34.210555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-853644600", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "networks": [{"uuid": "e182e83f-1d35-4925-a1e8-7545c18bde85"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:34.469153 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] validate_networks() for [('e182e83f-1d35-4925-a1e8-7545c18bde85', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:45:34.578204 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:34.578827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:34.596763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:34.597933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:34.605638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:34.606579 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:34.868031 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:34.880112 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bde57524-08f8-475e-914f-44fbe8ec1d5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.306465 Apr 05 13:45:34.881177 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 145/276] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:34 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:35.008867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:35.011757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:35.023725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.025367 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:35.026553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.027732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:35.284052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:35.308045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:35.312645 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:35.315646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8d638fbb-7759-4a3e-a442-a355a88bbd81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.311026 Apr 05 13:45:35.318534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 146/277] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:35 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:35.342263 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:45:35.342760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:45:35.343149 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:45:35.343578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:45:35.343991 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:45:35.357375 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.360226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:35.362706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.364352 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:35.413751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Getting quotas for project f065b9be718746fe906f667735f52b74. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:35.421077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Getting quotas for user 0448d4373e2c48da82192343ce414f99 and project f065b9be718746fe906f667735f52b74. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:35.445423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:45:35.447830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:45:35.555629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-859079c0-9f1e-4bdb-8376-e910f6609eed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353064 Apr 05 13:45:35.556594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 132/278] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:45:35.568011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0e088a9f-3e69-4e1e-b33d-23b52df566c6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:35.568983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0e088a9f-3e69-4e1e-b33d-23b52df566c6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:35.675811 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0e088a9f-3e69-4e1e-b33d-23b52df566c6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:35.687288 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0e088a9f-3e69-4e1e-b33d-23b52df566c6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1213 microversion: 2.1 time: 0.124267 Apr 05 13:45:35.688586 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 147/279] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:35 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:35.898507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:35.899379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:35.919242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.921466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:35.923179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:35.927004 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:36.338361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:36.339743 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:36.348795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:36.352911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:36.354170 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:36.356554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:36.389825 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:36.397943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d15ba636-da12-4936-ab80-18c0e565a737 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.504173 Apr 05 13:45:36.402978 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 133/280] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:35 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:36.529885 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1118454410", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3cff852-d241-43ab-830a-cae40270149a"}], "security_groups": [{"name": "tempest-securitygroup--851036108"}], "key_name": "tempest-keypair-2097392087", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:36.665511 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:36.679296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:36.682871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:36.684482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-415fbaf9-b3b9-4fbc-abe5-43f5a554cbc2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.350485 Apr 05 13:45:36.686301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 148/281] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:36 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:36.720844 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:36.721658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:36.728424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:36.729099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:36.730228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:36.730875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:36.779843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] validate_networks() for [('c3cff852-d241-43ab-830a-cae40270149a', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:45:36.894938 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:36.908388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7275a2f0-fdcf-447e-a6c2-34030e53e179 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1209 microversion: 2.1 time: 0.196772 Apr 05 13:45:36.909096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 149/282] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:36 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:37.423642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:37.424271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:37.445024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.445934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.447072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.448498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.773023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:45:37.773628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:45:37.774273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:45:37.774926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:45:37.775445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:45:37.789940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.793355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.796188 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.796722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.834429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:37.862628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:37.874201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9702d6da-5e79-42dc-a903-37b314b2f899 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.456348 Apr 05 13:45:37.875242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 150/283] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:37 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:37.883246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:37.884486 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:37.895003 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.895763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:37.896108 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.902280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:37.903284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:37.946966 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:45:37.958676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:45:38.068288 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-30ef3a1b-3c7a-411d-a413-33b87f55758c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.542842 Apr 05 13:45:38.070064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 134/284] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:45:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:45:38.076148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:38.077544 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:38.085795 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:38.087374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:38.089193 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:38.090345 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:38.198446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:38.212769 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bce2c9e7-9b84-4130-8d51-799e57214918 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1271 microversion: 2.1 time: 0.138466 Apr 05 13:45:38.213649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 135/285] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:38 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:38.223847 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0dc56ecb-426e-43a5-a082-970008ca56f9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:38.226464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0dc56ecb-426e-43a5-a082-970008ca56f9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:38.257945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:38.272525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:38.274719 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:38.276199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6a4d42c4-9cf3-4c62-8300-c890c514781d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1745 microversion: 2.20 time: 0.399828 Apr 05 13:45:38.279004 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 151/286] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:37 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1745 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:38.555785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0dc56ecb-426e-43a5-a082-970008ca56f9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:38.568590 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0dc56ecb-426e-43a5-a082-970008ca56f9 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1242 microversion: 2.1 time: 0.353606 Apr 05 13:45:38.569464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 136/287] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:38 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1242 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:38.892584 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:38.893400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:38.905147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:38.905614 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:38.909289 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:38.909571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.234844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:39.235467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:39.248843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.249300 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.250089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.261686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:39.283081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.283363 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f90342ee-2638-47cd-be1a-e8bb3f064e1b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.393047 Apr 05 13:45:39.287162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 152/288] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:38 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:39.302199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:39.306717 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:39.323756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.324451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.325828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.326945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.566550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:39.576294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:39.577823 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:39.579161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-72526561-bf0b-4543-9a2c-bc5192e1fc46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1745 microversion: 2.20 time: 0.282308 Apr 05 13:45:39.581509 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 153/289] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:39 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1745 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:39.608433 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:39.609056 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:39.615479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.615982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.617005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:39.617205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:39.877149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:39.887991 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aefe3954-5ab8-4a5d-ab69-ca20f889e5b8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1302 microversion: 2.1 time: 0.305119 Apr 05 13:45:39.890466 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 154/290] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:39 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1302 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:40.289093 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:40.303390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c2cc9ecb-3a18-4485-9e86-7f668b65f4c5 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 1.075595 Apr 05 13:45:40.308767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:40.313340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:40.316491 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 137/291] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:39 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:40.332354 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:40.344133 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:40.345063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:40.345511 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:40.604108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:40.607670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:40.614611 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:40.615422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:40.617137 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:40.617792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:40.967048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:40.986011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e00f998f-745b-43cc-a5bb-681306c895af tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.683569 Apr 05 13:45:40.999645 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 155/292] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:40 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:41.013340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:41.014286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:41.029055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.033209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.034494 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.035176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.244457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:41.268550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-21aa85e9-7c63-436d-93bb-ec9e2a25188c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1300 microversion: 2.1 time: 0.261429 Apr 05 13:45:41.279839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:41.295719 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 156/293] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:41 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1300 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:41.304918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-98d2ef01-83d5-468c-ba50-b8435791e71c req-80477f16-6280-4cfe-8db3-13a8961046cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "name": "network-vif-plugged", "status": "completed", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:41.305665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:41.315570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:41.319086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2bcdace6-15e9-4f5d-8b88-4fe139b5e487 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.720578 Apr 05 13:45:41.327757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 138/294] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:40 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:41.344008 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:41.344750 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:41.353325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-98d2ef01-83d5-468c-ba50-b8435791e71c req-80477f16-6280-4cfe-8db3-13a8961046cd service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.353957 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-98d2ef01-83d5-468c-ba50-b8435791e71c req-80477f16-6280-4cfe-8db3-13a8961046cd service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.357970 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.359895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.361943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.364063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.374657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-98d2ef01-83d5-468c-ba50-b8435791e71c req-80477f16-6280-4cfe-8db3-13a8961046cd service nova] Creating event network-vif-plugged:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:45:41.387784 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-98d2ef01-83d5-468c-ba50-b8435791e71c req-80477f16-6280-4cfe-8db3-13a8961046cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082005 Apr 05 13:45:41.390509 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 157/295] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:45:41.580482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-8f830424-4aee-4a30-af4c-6acc892fb2a1 req-2143ec50-c3ed-42cd-98c5-1492467dd0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9a7ca6-d28c-4983-a53c-e4fb53299efc", "tag": "ae64f1b0-d20b-4b9d-bd73-4911753e24e8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:41.599988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8f830424-4aee-4a30-af4c-6acc892fb2a1 req-2143ec50-c3ed-42cd-98c5-1492467dd0c2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:41.602833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8f830424-4aee-4a30-af4c-6acc892fb2a1 req-2143ec50-c3ed-42cd-98c5-1492467dd0c2 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:41.634584 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-8f830424-4aee-4a30-af4c-6acc892fb2a1 req-2143ec50-c3ed-42cd-98c5-1492467dd0c2 service nova] Creating event network-changed:ae64f1b0-d20b-4b9d-bd73-4911753e24e8 for instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc on hv-cinder-83587 Apr 05 13:45:41.651051 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-8f830424-4aee-4a30-af4c-6acc892fb2a1 req-2143ec50-c3ed-42cd-98c5-1492467dd0c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078007 Apr 05 13:45:41.652160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 158/296] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:45:41.967751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:41.982445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ed007730-beb2-4f65-91e3-cdf1c5004d46 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.658665 Apr 05 13:45:41.985738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 139/297] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:41 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:42.006421 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:42.007412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:42.024035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.024471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.025487 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.025936 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.305258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:42.306638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:42.318235 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.318692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.319474 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.319915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.688347 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:42.700419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-23685406-ecef-4994-9973-a80e399ca2c3 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.403068 Apr 05 13:45:42.702983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 140/298] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:42 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:42.728113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:42.745093 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:42.765240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.769700 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.771769 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:42.774496 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:42.781581 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:42.790498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-db303603-c05b-4e98-9234-202dfc17ccee tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.788588 Apr 05 13:45:42.810322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 159/299] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:42 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:42.818797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'create', calling method: .version_select at 0x7f9bfdac2430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-709335281"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:42.889317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:42.901415 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for user d72a02ac11da4c6898f1ec9fa1c310f3 and project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:43.034308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:43.044919 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:43.050429 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:43.053247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-700a6e3e-dc8e-4748-9ccd-c0a246a3794e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.348840 Apr 05 13:45:43.057492 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 141/300] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:42 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:43.064567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:43.069975 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:43.084975 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:43.085665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:43.086697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:43.087296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:43.179738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:43.190433 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for user d72a02ac11da4c6898f1ec9fa1c310f3 and project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:43.226164 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b2c7ed7e-9afa-4c4c-a8a0-7c0fb9a19511 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.413015 Apr 05 13:45:43.233053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 160/301] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:45:42 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:43.352651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:43.366290 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9462d5ed-fd59-43ee-bddb-707770900a94 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.305670 Apr 05 13:45:43.367413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 142/302] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:43 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:43.417370 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1823447083", "imageRef": "444b2640-7dea-44b3-8811-7e8ba483e0f0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-709335281", "networks": [{"uuid": "c3577407-2ce1-48bb-9562-9c8640b0a046"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:43.525376 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] validate_networks() for [('c3577407-2ce1-48bb-9562-9c8640b0a046', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:45:43.538489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-93243f8c-cb07-46cf-8e1a-93cca91706b2 req-b3c87e38-49f3-40c9-b095-d03a3c24c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347", "tag": "0b8b738b-1903-4b5f-b33b-44e6534a54e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:43.552348 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-93243f8c-cb07-46cf-8e1a-93cca91706b2 req-b3c87e38-49f3-40c9-b095-d03a3c24c1c6 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:43.561154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-93243f8c-cb07-46cf-8e1a-93cca91706b2 req-b3c87e38-49f3-40c9-b095-d03a3c24c1c6 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:43.577815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-93243f8c-cb07-46cf-8e1a-93cca91706b2 req-b3c87e38-49f3-40c9-b095-d03a3c24c1c6 service nova] Creating event network-changed:0b8b738b-1903-4b5f-b33b-44e6534a54e6 for instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 on hv-cinder-83587 Apr 05 13:45:43.585271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-93243f8c-cb07-46cf-8e1a-93cca91706b2 req-b3c87e38-49f3-40c9-b095-d03a3c24c1c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050780 Apr 05 13:45:43.586279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 143/303] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:45:43.724191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:43.725681 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:43.748716 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:43.749179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:43.749971 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:43.750414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.322513 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:44.332358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7a336155-5f8a-4d68-be10-73552119546d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.615995 Apr 05 13:45:44.332941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 144/304] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:43 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:44.346895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:44.347596 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:44.359262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.359947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.360881 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.361536 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.530619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:44.539130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d042acc8-e75f-4150-92c4-d71602b838a7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.204929 Apr 05 13:45:44.540350 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 145/305] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:44 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:44.559049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:44.560037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:44.571134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.572380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.574267 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.575338 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.612441 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:45:44.613491 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:45:44.613960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:45:44.614546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:45:44.614957 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:45:44.634650 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.635418 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.636681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.637473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.660060 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:45:44.664417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Getting quotas for user d72a02ac11da4c6898f1ec9fa1c310f3 and project ad212df8938b49c5b4ea37ea0e5428d5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:45:44.678741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:45:44.684690 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='444b2640-7dea-44b3-8811-7e8ba483e0f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:45:44.738371 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dd873ce7-f2de-4cd7-ba4d-ea5371c2f4ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325740 Apr 05 13:45:44.739676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 161/306] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:45:44.746328 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:44.747123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:44.757449 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.758088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.759030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:44.759670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:44.814984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:44.823337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:44.832419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:44.833688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ee09e3fa-6b9b-4ee4-9856-c7856626a053 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.291910 Apr 05 13:45:44.837782 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 146/307] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:44 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:44.862929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-51430f32-e819-499c-9b3f-87a4e9154c74 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:44.863861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-51430f32-e819-499c-9b3f-87a4e9154c74 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:44.992647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-51430f32-e819-499c-9b3f-87a4e9154c74 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:45.001843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-51430f32-e819-499c-9b3f-87a4e9154c74 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1258 microversion: 2.1 time: 0.161319 Apr 05 13:45:45.003107 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 147/308] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:44 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:45.152126 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:45.166447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2f1228ef-4532-4cb7-a2a3-8d6502a6e2bf tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.425395 Apr 05 13:45:45.169261 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 162/309] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:44 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:45.350621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:45.352270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:45.371002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.371849 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.380058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.380629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.562191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:45.563778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:45.577381 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.578503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.579416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.580451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.616714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:45.625545 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d4e3684c-baa0-4a5e-9528-bebc86e8bffd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.280130 Apr 05 13:45:45.626968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 148/310] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:45 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:45.857661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:45.858656 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:45.865068 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.865841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.867000 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:45.867638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:45.960199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:45.977028 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-657370cf-8a1f-436c-aeba-a5d7622687ff tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.414294 Apr 05 13:45:45.978260 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 163/311] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:45 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:46.019037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:46.020110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:46.031011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.035290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.036620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.037297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.074673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:46.084369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:46.086091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:46.087391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-46031538-895b-41a1-a094-1dbd29a218eb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.238304 Apr 05 13:45:46.101027 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 149/312] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:45 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:46.188830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:46.189698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:46.193311 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:46.199719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.200354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.201552 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.202005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.204637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e689172a-81fc-4eb7-b14b-24eea4b3c1ca tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1262 microversion: 2.1 time: 0.188518 Apr 05 13:45:46.207664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 164/313] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:46 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1262 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:46.397669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:46.407124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a4047fcd-ab6c-4e81-9671-01788c3aeb29 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.227151 Apr 05 13:45:46.418322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 150/314] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:46 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:46.643082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:46.643939 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:46.650842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.651445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.652448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:46.652995 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:46.998150 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:46.998763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:47.008120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.008574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.009372 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.009814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.078744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.087836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-494220de-4fb7-47d8-a67b-82bbb2d7986b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.448595 Apr 05 13:45:47.104072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 165/315] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:46 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:47.113357 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:47.114625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:47.129768 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.130961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.132204 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.133118 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.232975 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.251476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-52077192-a020-4995-980b-613a47c0870e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.257630 Apr 05 13:45:47.254971 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 151/316] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:46 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:47.270005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:47.271175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:47.286906 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.288441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.289880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.292976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.482093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.490520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.503527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.510628 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-758194cb-0773-470a-bf82-19af777c7e95 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.400934 Apr 05 13:45:47.524553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 166/317] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:47 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:47.534431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:47.535234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:47.565309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.565821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.567438 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:47.567911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:47.596761 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:47.606140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5ff6ff1f-edc5-4924-ae04-ba761f2ecca3 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1262 microversion: 2.1 time: 0.349747 Apr 05 13:45:47.621438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 152/318] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:47 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1262 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:48.106584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:48.108496 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:48.116878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.118810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.121645 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.122325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.362177 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.374878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.386097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bbc00448-eebc-4e27-bb1d-a0dcbfa288c5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.283064 Apr 05 13:45:48.399563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-15ccd603-cb12-4031-8b75-28c9e6f0e2b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.849302 Apr 05 13:45:48.399563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 167/319] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:47 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:48.400045 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 153/320] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:48 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:48.404364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:48.404364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:48.428636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.429088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.429869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.430308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.532509 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:48.533123 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:48.540693 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.541141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.541926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.542922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.751229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.778208 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.789232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.796351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7c99006c-4562-4656-b312-e7379cd2cdbb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.407143 Apr 05 13:45:48.797369 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 168/321] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:48 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:48.811938 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:48.814877 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:48.817029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:48.820600 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7f938f09-d86c-451f-823f-5876d1820033 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.292048 Apr 05 13:45:48.823692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 154/322] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:48 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:45:48.838784 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.839790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.841293 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:48.842083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:48.983326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:49.020329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2a1ec470-5e09-4520-8065-8e6c263a8dcb tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1310 microversion: 2.1 time: 0.213900 Apr 05 13:45:49.020974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 169/323] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:48 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1310 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:49.403155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:49.404254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:49.413659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:49.414098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.414835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:49.418955 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.420084 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.420737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.427635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.429027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.430336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.431048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.715068 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:49.727928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f691a45b-7cfb-46bb-910d-21070a240670 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.318945 Apr 05 13:45:49.728831 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 170/324] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:49 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:49.740031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:49.748752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-186bf1fe-d8ed-45f1-b54c-616d3495eb5e tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.349375 Apr 05 13:45:49.749345 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 155/325] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:49 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:49.815196 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:49.815845 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:49.829546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.830461 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.831484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.832105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.842498 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:49.843279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:49.853619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.854949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:49.856813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:49.857974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.059956 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:50.075990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-286a6b1c-9496-4132-9d6f-28622b73a659 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.265280 Apr 05 13:45:50.080231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 171/326] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:49 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:50.085091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:50.086345 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:50.092534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.093198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.094163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.094753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.180916 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:50.196832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:50.210219 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:50.217478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:50.218851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-956c5a27-a990-4400-94ce-933755b6f994 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.381485 Apr 05 13:45:50.221694 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7430aa68-fab1-440a-ba84-237051415e84 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1310 microversion: 2.1 time: 0.140314 Apr 05 13:45:50.223535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 156/327] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:49 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:50.235062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 172/328] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:50 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1310 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:50.752693 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:50.754918 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:50.767441 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:50.768858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:50.783656 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.784139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.784942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.787378 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.789759 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.790004 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:50.790835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:50.791272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.388405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:51.401564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-26ad8327-6ae3-45c6-aead-8b86e6b0f887 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.638121 Apr 05 13:45:51.402908 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 173/329] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:50 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:51.410144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:51.410941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:51.418171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.419300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.420415 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.421016 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.759340 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:51.800476 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:51.803147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c35203d2-4ebc-445e-b664-67427057b1f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 1.061414 Apr 05 13:45:51.811262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4757d547-d9ff-45cb-ad3f-362c64691bc6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.406225 Apr 05 13:45:51.816992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 174/330] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:51 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:51.838439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 157/331] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:50 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:51.865117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:51.866058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:51.876566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:51.876566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:51.889914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.890668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.892418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.893037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.899235 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.902246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:51.904096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:51.905693 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.091160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:52.109075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5dbe6c13-1d4d-4eab-b075-fca2b8dc2f89 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1316 microversion: 2.1 time: 0.290097 Apr 05 13:45:52.112787 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 175/332] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:51 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:52.419195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:52.419918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:52.426924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.427708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.428723 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.429359 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.626146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:52.641198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-966351d8-0b92-4a3c-8677-b7f76103be45 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.226732 Apr 05 13:45:52.652383 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 176/333] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:52 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:52.768068 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:52.784957 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:52.802302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:52.809193 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-932c388f-3006-4906-8d33-24836fa04b47 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.977446 Apr 05 13:45:52.812793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 158/334] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:51 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:52.824061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:52.824699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:52.839395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.839878 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.848379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:52.848998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:52.853148 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.853745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.881111 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.881566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:52.882377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:52.899871 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.244135 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:53.257778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1d177a6c-7707-4b5d-a6f1-05ee68ec92d5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.438149 Apr 05 13:45:53.260543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 177/335] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:52 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:53.265731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:53.266708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:53.273276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.273988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.275080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.275733 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.410558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:53.423349 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5131c87b-1402-4d22-8f1d-48ed3cbdf7c1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1316 microversion: 2.1 time: 0.160498 Apr 05 13:45:53.426534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 178/336] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:53 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:53.455585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:53.475018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-de846541-1a8b-4ead-8963-7683ac07f024 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.631569 Apr 05 13:45:53.476851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 159/337] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:52 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:53.660510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:53.661570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:53.670729 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.673300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.701469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.703002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.836141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:53.837392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:53.865022 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.865789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.866795 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:53.867394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:53.962384 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:53.977528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-959fce8a-d3ad-4950-8ed9-695996afc825 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.320851 Apr 05 13:45:53.987718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 179/338] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:53 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:53.997885 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-ac2072d0-55d7-4a4e-94ab-f26f7b735d58 req-fcb48828-7673-4243-920b-6fd6c6440449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9a7ca6-d28c-4983-a53c-e4fb53299efc", "name": "network-vif-plugged", "status": "completed", "tag": "ae64f1b0-d20b-4b9d-bd73-4911753e24e8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:54.023562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ac2072d0-55d7-4a4e-94ab-f26f7b735d58 req-fcb48828-7673-4243-920b-6fd6c6440449 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.024318 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ac2072d0-55d7-4a4e-94ab-f26f7b735d58 req-fcb48828-7673-4243-920b-6fd6c6440449 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.053716 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-ac2072d0-55d7-4a4e-94ab-f26f7b735d58 req-fcb48828-7673-4243-920b-6fd6c6440449 service nova] Creating event network-vif-plugged:ae64f1b0-d20b-4b9d-bd73-4911753e24e8 for instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc on hv-cinder-83587 Apr 05 13:45:54.066419 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-ac2072d0-55d7-4a4e-94ab-f26f7b735d58 req-fcb48828-7673-4243-920b-6fd6c6440449 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076829 Apr 05 13:45:54.068301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 180/339] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:45:54.153408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.164635 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.170677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.172319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7f1b9563-ef69-4251-933e-61bdc7af49b7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.340357 Apr 05 13:45:54.172909 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 160/340] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:53 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:54.280618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:54.281638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:54.291566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.292186 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.293279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.293812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.442237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:54.443355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:54.451935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.456406 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.457523 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.458829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.604296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.614309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c4c032fa-1950-4e72-8c5e-926331bea31c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.341793 Apr 05 13:45:54.625215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 181/341] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:54 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:54.632150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:54.633202 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:54.641344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.642248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.644154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:54.645244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:54.768260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.780322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2442f247-cc0d-4107-8f2a-0eb8a076d6ff tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.341852 Apr 05 13:45:54.788058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 161/342] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:54 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:45:54.872519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:54.883524 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ea2a15ec-b7ae-4697-9960-a85256aa6aeb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.255393 Apr 05 13:45:54.895988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 182/343] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:54 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:54.994657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:54.995349 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:55.002882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.003713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.004688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.005471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.190692 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:55.191953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:55.204643 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.206459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.208159 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.208953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.329571 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:55.338047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a32677c6-3df3-4a5c-bea0-ab7215ed7b92 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.347172 Apr 05 13:45:55.340828 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 162/344] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:54 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:55.464891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:55.494757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:55.499445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:55.503490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9f0b9917-9500-4092-bc17-375397098da0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.315010 Apr 05 13:45:55.504847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 183/345] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:55 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:45:55.634140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:55.634675 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:55.644169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.644627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.653626 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.654370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.816968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:55.817563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:55.832129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.832591 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:55.833381 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:55.834368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.303174 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:56.327248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4d252f42-1adc-4a2d-ad9d-2f6d1f6dce8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.519074 Apr 05 13:45:56.328327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 184/346] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:55 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:56.345576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:56.346201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:56.360767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.361228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.362017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.362452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.724931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:56.740606 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2681bbff-a978-4885-9409-da17288ffbb8 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 1.106396 Apr 05 13:45:56.763749 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 163/347] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:55 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:56.773471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:56.776250 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:56.791272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.791986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.804489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.805528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.944039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:56.952665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f378de58-b49d-4d2f-9e53-18df597a5265 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1501 microversion: 2.1 time: 0.623166 Apr 05 13:45:56.957895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 185/348] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:56 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1501 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:56.963304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:56.968370 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:56.980482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.981890 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:56.982872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:56.983472 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.314859 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:57.328666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:57.330438 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:57.331681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-58267002-dff1-4ea9-bb2a-4d5a8d4b76f4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.372348 Apr 05 13:45:57.338533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 186/349] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:56 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:57.343543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b67fa69-3840-4cda-b492-38a1c549548c"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:57.352117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:57.361926 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.362417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.363210 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.363678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.419662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] HTTP exception thrown: Cannot 'attach_volume' instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 while it is in vm_state rescued Apr 05 13:45:57.429852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Returning 409 to user: Cannot 'attach_volume' instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 while it is in vm_state rescued {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:45:57.431270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a0b50bc4-edd2-4475-a9b9-0f56e205dc24 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091650 Apr 05 13:45:57.432395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 187/350] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:45:57 2022] POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 13:45:57.438170 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:57.439027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:57.458753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.459415 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.460713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.461304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.860554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:57.875962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dd8f9ca9-3c09-40e2-ac7a-fbca54a0d5b2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.438859 Apr 05 13:45:57.880619 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 188/351] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:57 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:57.893227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:45:57.923144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:57.939310 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.940236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:57.941325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:57.942015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.130642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0f6fdccd-7f70-4f90-bec9-2f26329f0847 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/action" status: 202 len: 0 microversion: 2.1 time: 0.247248 Apr 05 13:45:58.134515 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 189/352] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:45:57 2022] POST /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:45:58.144883 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:58.148035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:58.164132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.165018 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.166227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.168297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.346594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:58.355936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c35b3886-1750-492d-9905-2bd378bdffed tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 1.590641 Apr 05 13:45:58.360627 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 164/353] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:56 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:58.373384 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:58.374197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:58.389092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.391543 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.392547 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.393882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.485654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:58.496932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed529d33-edc9-42ac-99d8-b10cdae82840 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.363951 Apr 05 13:45:58.508979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 190/354] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:58 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:58.514461 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:58.515934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:58.522962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.523812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.524873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.525535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.783390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:58.795490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:58.798103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:58.800553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-47d5a6e1-2cf2-4bff-acce-51b67b157826 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.289448 Apr 05 13:45:58.801525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 191/355] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:45:58 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:45:58.904674 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:58.905418 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:58.929292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.931322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:58.932317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:58.938324 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:59.054958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:59.090369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-13a0fe97-5818-4448-870f-5a989baa762a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.728249 Apr 05 13:45:59.106129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 165/356] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:58 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:59.320668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:59.344327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d1bcfb24-ecb4-4390-9f4b-996f7c229f47 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.451542 Apr 05 13:45:59.358522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 192/357] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:58 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:45:59.376196 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:59.378683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:59.397131 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:59.397714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:59.404613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:59.407415 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:59.515903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:45:59.516584 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:45:59.551369 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:59.552527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:59.553615 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:45:59.574865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:45:59.978612 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:45:59.989161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8d16a600-19c3-40f2-8956-dc69c053014a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.478690 Apr 05 13:46:00.000917 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 193/358] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:59 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:00.010329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:00.011675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:00.026139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.026348 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.027054 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.027922 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.101048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.111983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-88e3e39b-cbaa-4465-a1ef-7be59b269405 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1313 microversion: 2.1 time: 0.740407 Apr 05 13:46:00.122124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 166/359] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:45:59 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:00.127235 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:00.140168 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:00.165914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.167479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.169239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.170945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.402201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.413331 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.416606 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.419178 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3592f940-439c-42ea-8dd5-9e1631a09bd0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1740 microversion: 2.20 time: 0.416640 Apr 05 13:46:00.420550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 194/360] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:00 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:00.426958 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:00.427928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:00.434900 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.435739 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.437088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.437784 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:00.788002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.819424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d9365236-601c-48e1-a2fb-308d56b4bf76 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.385474 Apr 05 13:46:00.835042 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 195/361] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:00 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:00.886863 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:00.893438 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-51eb217e-4df0-45f0-8a1f-77ed8ec37a7c req-c875f40f-4323-447f-a606-a8daa651a256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:00.896007 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3a8b1187-1f38-4bfd-bb56-75c0273670f2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.772644 Apr 05 13:46:00.903170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 167/362] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:00 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:00.955216 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-51eb217e-4df0-45f0-8a1f-77ed8ec37a7c req-c875f40f-4323-447f-a606-a8daa651a256 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:00.955903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-51eb217e-4df0-45f0-8a1f-77ed8ec37a7c req-c875f40f-4323-447f-a606-a8daa651a256 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.014462 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-51eb217e-4df0-45f0-8a1f-77ed8ec37a7c req-c875f40f-4323-447f-a606-a8daa651a256 service nova] Creating event network-changed:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:46:01.018002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:01.018848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:01.036898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.037567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.038625 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.041690 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.042777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-51eb217e-4df0-45f0-8a1f-77ed8ec37a7c req-c875f40f-4323-447f-a606-a8daa651a256 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161885 Apr 05 13:46:01.049220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 196/363] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:01.147545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:01.151767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:01.168482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.170749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.172469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.173754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.524122 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:01.536541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e4655a0b-c68c-4e92-a7b8-1293a9ee3166 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1496 microversion: 2.1 time: 0.403016 Apr 05 13:46:01.550247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 197/364] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:01 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1496 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:01.562200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:01.563065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:01.578710 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.579165 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:01.582300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:01.582932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.135558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:02.152327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:02.157873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:02.159565 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7a976f1b-64a8-4a16-9e1c-3ad85837f425 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.606369 Apr 05 13:46:02.169507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 198/365] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:01 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:02.177402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:02.188498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:02.206400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.208583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.210654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.213013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.564613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:02.575027 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-42de7f9f-3514-42e9-bf0b-fde68a23995a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 1.560900 Apr 05 13:46:02.578452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 168/366] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:01 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:02.602341 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:02.605507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:02.635778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.636311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.642952 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.644500 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.823777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:02.834766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aba99ce3-b535-47b2-8f7c-af4430eed821 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.661742 Apr 05 13:46:02.835456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 199/367] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:02 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:02.841635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:02.842131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:02.893762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.894240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.895061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:02.895533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:02.981454 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:46:03.227333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a5acf3b3-0023-43ee-8903-a17629b47209 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 204 len: 0 microversion: 2.1 time: 0.381102 Apr 05 13:46:03.229009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 200/368] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:46:02 2022] DELETE /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:46:03.244429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-4dad25c8-2914-4d32-8233-a5a4526f212a req-24df8dad-2f16-405a-812b-a9947f23651f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347", "name": "network-vif-plugged", "status": "completed", "tag": "0b8b738b-1903-4b5f-b33b-44e6534a54e6"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:03.259058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4dad25c8-2914-4d32-8233-a5a4526f212a req-24df8dad-2f16-405a-812b-a9947f23651f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.259843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4dad25c8-2914-4d32-8233-a5a4526f212a req-24df8dad-2f16-405a-812b-a9947f23651f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.274722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-4dad25c8-2914-4d32-8233-a5a4526f212a req-24df8dad-2f16-405a-812b-a9947f23651f service nova] Creating event network-vif-plugged:0b8b738b-1903-4b5f-b33b-44e6534a54e6 for instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 on hv-cinder-83587 Apr 05 13:46:03.286627 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-4dad25c8-2914-4d32-8233-a5a4526f212a req-24df8dad-2f16-405a-812b-a9947f23651f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055542 Apr 05 13:46:03.287871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 201/369] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:03.294736 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:03.295810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:03.314183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.314183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.314183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.314183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.654042 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:03.668992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:03.673925 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:03.678848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-11b13581-eba0-4d28-8c63-55f1fe664cd5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.388979 Apr 05 13:46:03.680241 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 202/370] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:03 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:03.696992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:03.702173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:03.711993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.713386 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.716102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.716832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.889746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:03.906469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-29216c16-7af4-4dfc-9442-b8e25ee1f2a0 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 1.325358 Apr 05 13:46:03.907892 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 169/371] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:02 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:03.913589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:03.914781 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:03.936606 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.936934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:03.937566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.940186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.941271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.945171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-317774d5-b013-43a9-97fc-c9d7ef45bb14 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.260349 Apr 05 13:46:03.948105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 203/372] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:03 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:03.955765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:03.962239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:03.975672 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.976127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:03.977177 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:03.977612 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:04.170228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:04.181678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-376edf20-8ed3-4ec2-af17-3e1fe68eda00 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.229675 Apr 05 13:46:04.182309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 204/373] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:03 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:04.253413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:04.261227 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-117f90cf-aca5-47ea-a1f1-c71c98171c7a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.351839 Apr 05 13:46:04.261813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 170/374] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:03 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:04.699298 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:04.700184 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:04.733905 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:04.734374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:04.735989 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:04.736447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:04.928972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:04.929601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:04.950370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:04.950833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:04.959165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:04.959165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.071700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.080987 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.082494 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.083721 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-63e36839-ebb4-4bb8-bce4-0e6f5ce49730 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.389564 Apr 05 13:46:05.084430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 205/375] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:04 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:05.102101 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:05.102760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:05.119004 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.120518 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.130989 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.131592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.392935 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.402218 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e01fb7f9-1407-4ca8-ac74-a2f83325c221 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.316815 Apr 05 13:46:05.404184 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 206/376] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:05 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:05.411278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:05.414276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:05.434559 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.435017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.435995 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.439579 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.650220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.659110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-eb1ad8d9-366f-4fa5-afeb-096bb78ffcfc tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.253533 Apr 05 13:46:05.665247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 207/377] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:05 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:05.674067 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:05.678627 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:05.693738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.694481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.695440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.696094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.854175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:05.867351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-41ad4813-c554-487a-b9c6-df26e6fd1174 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.942557 Apr 05 13:46:05.878401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 171/378] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:04 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:05.887064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-78a85845-0b44-49ea-8896-b083b0d23cfa req-43d71da9-9e45-4c63-bd57-8d6b6aeae3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "name": "network-vif-unplugged", "status": "completed", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:05.919829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-78a85845-0b44-49ea-8896-b083b0d23cfa req-43d71da9-9e45-4c63-bd57-8d6b6aeae3b0 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:05.921151 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-78a85845-0b44-49ea-8896-b083b0d23cfa req-43d71da9-9e45-4c63-bd57-8d6b6aeae3b0 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:05.954858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-78a85845-0b44-49ea-8896-b083b0d23cfa req-43d71da9-9e45-4c63-bd57-8d6b6aeae3b0 service nova] Creating event network-vif-unplugged:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:46:05.965983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-78a85845-0b44-49ea-8896-b083b0d23cfa req-43d71da9-9e45-4c63-bd57-8d6b6aeae3b0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085594 Apr 05 13:46:05.967697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 172/379] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:06.104271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:06.105880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:06.123247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.127714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.128928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.131304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.399323 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.410252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-55ee778f-6cb3-4af0-ab20-a22f815c12e7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.743647 Apr 05 13:46:06.411658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 208/380] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:05 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:06.419832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:06.420745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:06.428805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.429508 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.431257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.431899 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.533903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.545502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.547479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.549008 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-842e3978-d070-43d4-9671-24278a8aa65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.450240 Apr 05 13:46:06.550551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 173/381] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:06 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:06.672151 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.679910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5e538ef6-a21c-44ce-9203-3f73d19047cb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.264171 Apr 05 13:46:06.690014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 209/382] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:06 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:06.690208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:06.690208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:06.691801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.692255 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.693033 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.693470 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.881929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:06.890957 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5878f10e-c106-4e2b-8281-76e0c7f4a25d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.212217 Apr 05 13:46:06.891572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 174/383] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:06 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:06.905557 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:06.906032 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:06.918743 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.919202 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.920079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:06.920461 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:06.962937 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Action: 'create', calling method: .version_select at 0x7f9bfd9543a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1005878422"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:06.998879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:07.003058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for user d7f06c5592fd4c7b9883f59c5501049c and project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:07.146260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:07.155118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-92b69b8a-3079-475d-8a14-34bb7f0852dd tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.261392 Apr 05 13:46:07.157931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 175/384] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:06 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:07.269332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:07.277998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for user d7f06c5592fd4c7b9883f59c5501049c and project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:07.297139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b2cfd189-3591-487f-a9aa-bfbd38cbb001 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.614524 Apr 05 13:46:07.298233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 210/385] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:46:06 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:07.429609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:07.430929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:07.441683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.442482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.443485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.444190 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.568568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:07.569168 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:07.578424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.581621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.584074 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.588175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.739918 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:07.752316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cbd5aad9-9416-404d-b8d8-5439644d9490 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.327037 Apr 05 13:46:07.752316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 176/386] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:07 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:07.772037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:07.773091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:07.795183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.796186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.800790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:07.801785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:07.998357 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.016753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.018858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.025211 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e889f318-9c89-4bbf-8fa1-2a894744a78c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.459938 Apr 05 13:46:08.026542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 211/387] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:07 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:08.028549 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.032405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:08.033617 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:08.041241 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-07010c7c-4036-4e45-88d0-6cc0091ed4e8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.282589 Apr 05 13:46:08.042318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 177/388] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:07 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:08.050215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.050663 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.053734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.054220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.057888 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-3d11f654-085e-4bd3-89dd-588454ae0637 req-6774dfed-0001-4505-bacc-2a110aba28fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9a7ca6-d28c-4983-a53c-e4fb53299efc", "name": "network-vif-unplugged", "status": "completed", "tag": "ae64f1b0-d20b-4b9d-bd73-4911753e24e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:08.076813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3d11f654-085e-4bd3-89dd-588454ae0637 req-6774dfed-0001-4505-bacc-2a110aba28fe service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.077423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3d11f654-085e-4bd3-89dd-588454ae0637 req-6774dfed-0001-4505-bacc-2a110aba28fe service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.112584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-3d11f654-085e-4bd3-89dd-588454ae0637 req-6774dfed-0001-4505-bacc-2a110aba28fe service nova] Creating event network-vif-unplugged:ae64f1b0-d20b-4b9d-bd73-4911753e24e8 for instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc on hv-cinder-83587 Apr 05 13:46:08.124645 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-3d11f654-085e-4bd3-89dd-588454ae0637 req-6774dfed-0001-4505-bacc-2a110aba28fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081218 Apr 05 13:46:08.127719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 178/389] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:08.179001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:08.180614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:08.188924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.189716 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.190754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.191392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.438982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.447939 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-45347d3f-40e8-4fdc-9b73-aaa4d530e854 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.419622 Apr 05 13:46:08.458129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 212/390] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:08 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:08.500869 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:08.521887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-be300c5f-0dda-49c4-9ea4-e49c19d910c4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.352655 Apr 05 13:46:08.522912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 179/391] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:08 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:08.768902 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:08.769920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:08.776993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.778336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:08.781630 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:08.784082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.053804 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:09.058251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:09.071546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.076633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.077783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.078733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.099198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.109257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ced72dcc-a084-499b-88a2-d9b558af28c6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.344289 Apr 05 13:46:09.120649 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 213/392] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:08 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:09.126102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:09.127515 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:09.134711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.135759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.136781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.137388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.364962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.374826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5b7e04b2-69e7-4491-a6cf-a68dafff4bfa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.251978 Apr 05 13:46:09.385737 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 214/393] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:09 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:09.466570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:09.467717 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:09.474578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.475105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.476052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.476854 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.825983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.836010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f3c7e221-a2f2-46cf-8673-4f14d69ce7ed tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.374408 Apr 05 13:46:09.836607 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 215/394] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:09 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:09.860655 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:09.861327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:09.866963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.877756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.877882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.878767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:09.879419 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:09.881923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.885476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:09.886920 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8483393e-5cc7-44c8-9d8c-0a05a9208286 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.846081 Apr 05 13:46:09.888002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 180/395] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:09 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:10.047484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:10.057906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-be8cfd35-cbbc-4f4f-a98b-cbb6cac79afa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.214797 Apr 05 13:46:10.059533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 216/396] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:09 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:10.126120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:10.126727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:10.133439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.133910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.134667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.135312 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.288897 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:10.300437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-975f4750-cf86-459d-b926-fe501d9d7a35 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.177776 Apr 05 13:46:10.311558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 181/397] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:10 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:10.392533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:10.393416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:10.401918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.402592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.403752 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.404417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.569147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:10.578540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aa918240-8ed3-45a1-bc96-3a50d3d1d0a8 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.189780 Apr 05 13:46:10.585645 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 217/398] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:10 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:10.857401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:10.860268 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:10.866556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.867091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.868095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.868666 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.910291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:10.913703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:10.924722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.925246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:10.926158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:10.926683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.459970 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:11.480509 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0f827fee-7aa5-447b-bc2f-396ba3187211 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.623233 Apr 05 13:46:11.481329 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 182/399] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:10 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:11.502097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:11.505698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:11.529532 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.530058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.533529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.534217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.739469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:11.752428 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:11.755263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:11.756558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8e4c1fab-4062-47b0-9306-091deaa66f59 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.855076 Apr 05 13:46:11.768014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 218/400] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:10 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:11.782024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:11.783290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:11.796437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.797519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.798600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.800258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.800423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:11.810800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e78ab8d1-d47b-409a-9293-ab244d8102a1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.325008 Apr 05 13:46:11.811953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 183/401] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:11 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:11.816933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:11.817767 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:11.825048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.827763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:11.831766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:11.834399 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.009093 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.019229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-54dd3e4e-83bb-4551-bf24-7b81065b8e07 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1502 microversion: 2.1 time: 0.205914 Apr 05 13:46:12.020076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 184/402] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:11 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:12.100509 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.110063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5c8c63b5-ea5f-4825-85b9-dc2509e68b4e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.340816 Apr 05 13:46:12.110952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 219/403] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:11 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:12.267812 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-16a3b822-6527-41da-83a0-2c1068e03f0e req-28e38c69-47c2-4115-9ae2-6d2ceeebcb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9a7ca6-d28c-4983-a53c-e4fb53299efc", "name": "network-vif-deleted", "tag": "ae64f1b0-d20b-4b9d-bd73-4911753e24e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:12.276287 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-16a3b822-6527-41da-83a0-2c1068e03f0e req-28e38c69-47c2-4115-9ae2-6d2ceeebcb9c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.276721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-16a3b822-6527-41da-83a0-2c1068e03f0e req-28e38c69-47c2-4115-9ae2-6d2ceeebcb9c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.289350 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-16a3b822-6527-41da-83a0-2c1068e03f0e req-28e38c69-47c2-4115-9ae2-6d2ceeebcb9c service nova] Creating event network-vif-deleted:ae64f1b0-d20b-4b9d-bd73-4911753e24e8 for instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc on hv-cinder-83587 Apr 05 13:46:12.294490 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-16a3b822-6527-41da-83a0-2c1068e03f0e req-28e38c69-47c2-4115-9ae2-6d2ceeebcb9c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Apr 05 13:46:12.295081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 185/404] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:12.498654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:12.499266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:12.505172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.505622 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.506380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.506815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.650418 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.658536 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-302bafc3-6cf2-4a9f-85c7-297341d027c4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.164586 Apr 05 13:46:12.659130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 220/405] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:12 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:12.775969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:12.776882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:12.783751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.784317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.785133 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.785879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.827705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:12.828314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:12.834075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.834556 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.835325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:12.835790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:12.931353 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.941288 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.942793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.944021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3ead7b2a-8824-4960-a5bf-b4c09131d394 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.172452 Apr 05 13:46:12.944610 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 186/406] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:12 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:12.983295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:12.991892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b99a7285-519c-4865-a304-8df073c7bfb4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.167954 Apr 05 13:46:12.992678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 221/407] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:12 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:13.037747 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:13.038292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:13.044933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.045391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.046166 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.046604 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.112674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:13.120289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9c78b58b-af74-4a5c-9121-ebfc3144d3ff tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1460 microversion: 2.1 time: 0.086438 Apr 05 13:46:13.120884 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 187/408] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:13 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1460 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:13.128854 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:13.129468 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:13.135352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.135932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.136748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.137335 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.274108 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:13.281953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a557147d-544d-4605-af11-9d6d2d767829 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.156994 Apr 05 13:46:13.282505 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 222/409] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:13 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:13.610972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-deaed827-299a-4ae9-980a-1f997b988318 req-7738f47f-6c59-44be-b1bf-bc5915e9fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "name": "network-vif-plugged", "status": "completed", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:13.619807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-deaed827-299a-4ae9-980a-1f997b988318 req-7738f47f-6c59-44be-b1bf-bc5915e9fa4a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.620524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-deaed827-299a-4ae9-980a-1f997b988318 req-7738f47f-6c59-44be-b1bf-bc5915e9fa4a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.634268 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-deaed827-299a-4ae9-980a-1f997b988318 req-7738f47f-6c59-44be-b1bf-bc5915e9fa4a service nova] Creating event network-vif-plugged:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:46:13.640005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-deaed827-299a-4ae9-980a-1f997b988318 req-7738f47f-6c59-44be-b1bf-bc5915e9fa4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Apr 05 13:46:13.640607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 188/410] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:46:13.676195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:13.677063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:13.688642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.689105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.690156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.690730 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.853580 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:13.861921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e4db0398-6722-49b6-a640-bb666c114eb7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.189565 Apr 05 13:46:13.862513 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 223/411] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:13 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:13.963284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:13.964046 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:13.970127 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.970647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:13.971455 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:13.971911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.010267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:14.011514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:14.018062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.018593 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.019386 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.019826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.117727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.127282 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.128818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.129991 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-14c33e11-1b38-4b46-a15f-daa20e2f3627 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1722 microversion: 2.20 time: 0.171265 Apr 05 13:46:14.130550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 189/412] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:13 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:14.137898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:14.138500 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:14.144418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.144867 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.145630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.146065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.167026 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.174816 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a64ee972-1a2f-4fe3-9835-af9df1c1d344 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.168341 Apr 05 13:46:14.175490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 224/413] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:14 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:14.206284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.214280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ac0c7b7b-6c49-4564-b81b-dc3aab232d2a tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1298 microversion: 2.1 time: 0.080079 Apr 05 13:46:14.214790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 190/414] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:14 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:14.298769 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:14.299546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:14.306038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.306487 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.307891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.308373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.447388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:14.455078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d3b953e2-907f-46e0-8371-e45aa1da0a89 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.160079 Apr 05 13:46:14.455677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 225/415] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:14 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:14.880045 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:14.880699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:14.890380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.890845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:14.891674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:14.892115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.063726 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.071636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ecf0a5f2-b1eb-4f77-9013-e002c25a1e4d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.196260 Apr 05 13:46:15.072318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 191/416] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:14 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:15.150255 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:15.151837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.159136 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.159610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.160374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.160818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.193304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:15.194019 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.201664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.202197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.203332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.204161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.339034 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.349910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.351824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.355234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a6c6d103-5b6f-4731-97e1-b6596fd3e081 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1725 microversion: 2.20 time: 0.208555 Apr 05 13:46:15.356747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 226/417] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:15 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:15.362044 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:15.363212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.372014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.372763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.373568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.374134 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.386254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.394057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-76e3ddbf-d8af-4c77-8e8e-7d6a31f4f4f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1509 microversion: 2.1 time: 0.204914 Apr 05 13:46:15.396169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 192/418] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:15 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:15.403533 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf3f551-51ba-4eb2-b86f-a6daae296930"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:15.404895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.410947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.411396 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.412218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.412659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.417233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.418236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.419907 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lazy-loading 'fault' on Instance uuid 7e9a7ca6-d28c-4983-a53c-e4fb53299efc {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:46:15.496981 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.519523 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-921ceaac-2a17-4842-b319-52b99c273fea tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1303 microversion: 2.1 time: 0.161201 Apr 05 13:46:15.529117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 227/419] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:15 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:15.529117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:15.529117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.550024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.550481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.551261 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.552104 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.802912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a656ee2-4e5d-46f5-92dd-d7bd0d371b8e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405128 Apr 05 13:46:15.803555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 193/420] 10.222.0.59 () {62 vars in 1363 bytes} [Tue Apr 5 13:46:15 2022] POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments => generated 188 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:46:15.942494 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:15.943062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:15.951561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.952109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.952997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:15.953507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:15.966007 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:15.973189 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ce0c4096-ecbb-443f-87bb-577383fba2a0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1367 microversion: 2.1 time: 0.451332 Apr 05 13:46:15.973762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 228/421] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:15 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:16.064988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-284a595f-7b99-46b7-aa7d-895f9f017417 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/action" status: 202 len: 0 microversion: 2.20 time: 0.126548 Apr 05 13:46:16.065784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 194/422] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Apr 5 13:46:15 2022] POST /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 13:46:16.074332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:16.074944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:16.081236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.081687 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.082466 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.082905 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.099047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:16.099949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:16.110376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.110863 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.111699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.112154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.235219 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.244030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.246546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.247790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a14869cc-578d-4586-8550-d0a5c2c2e38d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1811 microversion: 2.20 time: 0.177875 Apr 05 13:46:16.248361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 229/423] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:16 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1811 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:16.272164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.280649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-83d79395-d2d6-4dab-bb5d-1f8802e2432f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.189640 Apr 05 13:46:16.281307 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 195/424] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:16 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:16.412072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:16.412679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:16.419072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.419545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.420307 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.420740 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.537037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:16.537660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:16.545719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.545719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.546858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.546858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.566213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.576290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-acf0a2d7-bc19-4054-a137-4ff91ec8d914 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1515 microversion: 2.1 time: 0.167968 Apr 05 13:46:16.580455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 230/425] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:16 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:16.600335 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:16.605901 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:16.606383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lazy-loading 'fault' on Instance uuid 7e9a7ca6-d28c-4983-a53c-e4fb53299efc {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:46:16.663612 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:16.673151 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-780affb6-1d80-46a1-bd9c-661b81f4ba08 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 200 len: 1303 microversion: 2.1 time: 0.140156 Apr 05 13:46:16.673976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 196/426] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:16 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:16.991168 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:16.992103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:16.999071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.000009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.001838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.002279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.266984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:17.267620 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:17.268470 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:17.273926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.274398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.275171 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.275712 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.276986 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-841411b3-7c4f-4ea0-a473-cf16f406f21b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1558 microversion: 2.1 time: 0.290496 Apr 05 13:46:17.277646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 231/427] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:16 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1558 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:17.293515 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:17.294014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:17.300827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.301292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.302084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.302523 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.390931 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-758bd5c1-ccda-407a-b8be-43b2278a0621 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101497 Apr 05 13:46:17.391571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 232/428] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:46:17 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:46:17.396279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:17.396882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:17.404338 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.405012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.406199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.407175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.433949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:17.442488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:17.445738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:17.447151 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5f24a4fa-5f74-44fe-9116-fef97f9ad8ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1751 microversion: 2.20 time: 0.184087 Apr 05 13:46:17.448254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 197/429] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:17 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:17.693380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:17.694002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 7e9a7ca6-d28c-4983-a53c-e4fb53299efc] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:17.700592 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.701045 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.701818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:17.702253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:17.715281 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] HTTP exception thrown: Instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc could not be found. Apr 05 13:46:17.715921 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Returning 404 to user: Instance 7e9a7ca6-d28c-4983-a53c-e4fb53299efc could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:46:17.716810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5fb500f8-8167-4a22-8981-b2b5d879f09d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc" status: 404 len: 111 microversion: 2.1 time: 0.027399 Apr 05 13:46:17.720376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 198/430] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:17 2022] GET /compute/v2.1/servers/7e9a7ca6-d28c-4983-a53c-e4fb53299efc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:46:17.821834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-373924054", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "networks": [{"uuid": "e182e83f-1d35-4925-a1e8-7545c18bde85"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:17.865622 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:17.874677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d9c797d4-c90e-40eb-ba2f-6a438b4543a4 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1358 microversion: 2.1 time: 0.482064 Apr 05 13:46:17.875389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 233/431] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:17 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1358 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:17.890437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] validate_networks() for [('e182e83f-1d35-4925-a1e8-7545c18bde85', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:46:17.967427 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: .version_select at 0x7f9bfd954790>, body: {"keypair": {"name": "tempest-keypair-1093365855"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:17.985024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:18.017971 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for user a24d703a07794f56b600cc29c0a1578d and project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:18.311660 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:18.316021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for user a24d703a07794f56b600cc29c0a1578d and project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:18.320565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:46:18.321051 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:46:18.321543 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:46:18.321956 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:46:18.322371 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:46:18.334920 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.335161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-95f28924-3876-4e86-b5f3-44d05b62b37a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.371588 Apr 05 13:46:18.335582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:18.341760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 234/432] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:46:17 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:18.341930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.341930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:18.370382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Getting quotas for project f065b9be718746fe906f667735f52b74. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:18.374516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Getting quotas for user 0448d4373e2c48da82192343ce414f99 and project f065b9be718746fe906f667735f52b74. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:18.387133 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:46:18.389629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:46:18.446122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-87afb70a-7ea4-4cb9-8acf-877a21397a7d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628126 Apr 05 13:46:18.446869 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 199/433] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:46:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 13:46:18.457305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cdbaddef-dbf0-437c-ad38-8b5a0398dcfb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:18.458210 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cdbaddef-dbf0-437c-ad38-8b5a0398dcfb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:18.468067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:18.473939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:18.484560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.485441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:18.486947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.493309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:18.531040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cdbaddef-dbf0-437c-ad38-8b5a0398dcfb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:18.541973 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cdbaddef-dbf0-437c-ad38-8b5a0398dcfb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1213 microversion: 2.1 time: 0.086392 Apr 05 13:46:18.542945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 235/434] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:18 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:18.798476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:18.807985 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:18.813515 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:18.818852 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0bc4f2e0-154a-4b22-a5ec-aed28f28041a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1753 microversion: 2.20 time: 0.355353 Apr 05 13:46:18.821514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 200/435] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:18 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1753 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:18.896838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:18.898106 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:18.928977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.929459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:18.930267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:18.930911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.406176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:19.416817 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0b035415-abb8-4c03-a9b8-27f9d2bf5861 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1548 microversion: 2.1 time: 0.527620 Apr 05 13:46:19.417411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 236/436] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:18 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1548 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:19.434088 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:19.435713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:19.444831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.445406 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.446258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.446921 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.560122 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:19.561025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:19.569836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.570592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.571615 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.572052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.696623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:19.709769 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-120b8d27-1a13-4fd5-9253-5b73a09011a0 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1265 microversion: 2.1 time: 0.153421 Apr 05 13:46:19.711385 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 237/437] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:19 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:19.736901 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:19.766072 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-808169d7-50c0-4213-83af-6fca7624a9ef tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1548 microversion: 2.1 time: 0.336314 Apr 05 13:46:19.768692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 201/438] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:19 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1548 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:19.795102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:19.795102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:19.796478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Searching by: {'deleted': False, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5'} {{(pid=123520) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 05 13:46:19.802251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-6cb6489f-e3aa-472c-b69b-481b13abf6a5 req-8c06f452-4eee-47c4-865b-b2213a1a1ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347", "tag": "0b8b738b-1903-4b5f-b33b-44e6534a54e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:19.824272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.826227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.827287 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.829444 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.830312 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6cb6489f-e3aa-472c-b69b-481b13abf6a5 req-8c06f452-4eee-47c4-865b-b2213a1a1ff8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.831051 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6cb6489f-e3aa-472c-b69b-481b13abf6a5 req-8c06f452-4eee-47c4-865b-b2213a1a1ff8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.864417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-6cb6489f-e3aa-472c-b69b-481b13abf6a5 req-8c06f452-4eee-47c4-865b-b2213a1a1ff8 service nova] Creating event network-changed:0b8b738b-1903-4b5f-b33b-44e6534a54e6 for instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 on hv-cinder-83587 Apr 05 13:46:19.872202 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-6cb6489f-e3aa-472c-b69b-481b13abf6a5 req-8c06f452-4eee-47c4-865b-b2213a1a1ff8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073473 Apr 05 13:46:19.873567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 202/439] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:19.884251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:19.885273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:19.892162 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.892829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.893891 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:19.894476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:19.972272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.multi_cell_list [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 05 13:46:20.193439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:20.207049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:20.215205 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:20.216996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fc711c3d-2567-4137-b9eb-f17f9f456e11 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.341988 Apr 05 13:46:20.230946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 203/440] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:19 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:20.258063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-de72d268-11a4-4cec-9803-09f814625a54 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.477166 Apr 05 13:46:20.259102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 238/441] 10.222.0.59 () {58 vars in 1124 bytes} [Tue Apr 5 13:46:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:20.270255 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:20.270873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:20.283087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:20.283711 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:20.284542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:20.285156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:20.554714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:20.562796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-600dda9e-ddf1-456a-98f1-c1500cabc429 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1548 microversion: 2.1 time: 0.296296 Apr 05 13:46:20.575071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 204/442] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:20 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1548 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:20.668886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1373204318", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f94a67a-4b4c-4b0c-b628-6c4483480757"}], "security_groups": [{"name": "tempest-securitygroup--961199762"}], "key_name": "tempest-keypair-1093365855", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:20.728722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:20.729094 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:20.739035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:20.739480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:20.740898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:20.741360 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:20.825192 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:20.832954 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7953b63f-27a2-4201-bf0e-b26ed69a3ea6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1271 microversion: 2.1 time: 0.109074 Apr 05 13:46:20.833850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 205/443] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:20 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:20.919555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] validate_networks() for [('4f94a67a-4b4c-4b0c-b628-6c4483480757', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:46:21.236063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:21.236680 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:21.242872 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:21.243315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:21.245306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:21.245764 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:21.395364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:21.404757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:21.406346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:21.407532 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fc671895-5008-41fa-9cbf-9a6de5d59000 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.175335 Apr 05 13:46:21.408095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 206/444] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:21 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:21.850469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:21.851380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:21.858632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:21.859197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:21.860151 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:21.860697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:21.925690 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:21.933584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ef2d565-19ce-4389-a6f1-48112b4f36b4 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1271 microversion: 2.1 time: 0.087133 Apr 05 13:46:21.934160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 207/445] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:21 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:22.191380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:46:22.191968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:46:22.192534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:46:22.193278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:46:22.193688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:46:22.199769 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45318de3-cbf4-4801-afb7-9cc606ba09eb"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:22.201189 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:22.204015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.204468 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.205274 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.205707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.207920 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.208603 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.209766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.210353 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.232035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:22.239201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Getting quotas for user a24d703a07794f56b600cc29c0a1578d and project a2098c6086f1416bacaabd9ec938bfa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:22.251742 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:46:22.254043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:46:22.312990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9f226ea5-5992-4106-b93b-7a1d18302d5b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.650031 Apr 05 13:46:22.313747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 239/446] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:46:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:46:22.338771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1000c6a4-8582-44fb-8111-09532e6ffa38 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:22.339407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1000c6a4-8582-44fb-8111-09532e6ffa38 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:22.436796 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1000c6a4-8582-44fb-8111-09532e6ffa38 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:22.444540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1000c6a4-8582-44fb-8111-09532e6ffa38 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1246 microversion: 2.1 time: 0.124965 Apr 05 13:46:22.456467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 240/447] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:22 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:22.463758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:22.465510 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:22.474587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.476634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.477778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.478564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.584156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5542f7f2-164c-41ed-8524-b4715145da78 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389241 Apr 05 13:46:22.585695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 208/448] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:46:22 2022] POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:22.832154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:22.866201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:22.888545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:22.896000 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2dce667c-27a4-4466-b88f-b050a7ed31a7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.436329 Apr 05 13:46:22.899071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 241/449] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:22 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:22.952347 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:22.953106 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:22.965399 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.966413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:22.968968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:22.969618 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:23.168550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:23.180282 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4f00aac5-4d72-45bd-842b-9048bed8873c tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.233450 Apr 05 13:46:23.181502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 209/450] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:22 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:23.458893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-93ad4d9e-b180-4100-bce6-0caa0b5c1d2a req-4a51b189-535f-4f55-b15e-ac3dae57729b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "738d62fc-2132-4bd8-bffd-08a3cf89dfca", "tag": "e10f2b70-8b96-425c-a38d-25644b3add9f"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:23.466053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:23.466753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:23.487850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:23.488315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:23.491005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-93ad4d9e-b180-4100-bce6-0caa0b5c1d2a req-4a51b189-535f-4f55-b15e-ac3dae57729b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:23.491459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-93ad4d9e-b180-4100-bce6-0caa0b5c1d2a req-4a51b189-535f-4f55-b15e-ac3dae57729b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:23.494294 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:23.495535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:23.505651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-93ad4d9e-b180-4100-bce6-0caa0b5c1d2a req-4a51b189-535f-4f55-b15e-ac3dae57729b service nova] Creating event network-changed:e10f2b70-8b96-425c-a38d-25644b3add9f for instance 738d62fc-2132-4bd8-bffd-08a3cf89dfca on hv-cinder-83587 Apr 05 13:46:23.511720 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-93ad4d9e-b180-4100-bce6-0caa0b5c1d2a req-4a51b189-535f-4f55-b15e-ac3dae57729b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056282 Apr 05 13:46:23.512883 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 242/451] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:23.601110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:23.610514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e46b958f-0e17-48a9-9973-949dec06c2cb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.148581 Apr 05 13:46:23.611798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 210/452] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:23 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:23.922277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:23.923480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:23.933783 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:23.934540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:23.935325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:23.935798 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:24.094345 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:24.102824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:24.104987 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:24.106147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2d75ab70-7287-48d0-9156-c0bbe9e2fa0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.191093 Apr 05 13:46:24.106710 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 243/453] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:23 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:24.198824 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:24.200303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:24.207256 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:24.208330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:24.209488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:24.210392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:24.371031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:24.378528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cbf877b2-bd0d-44c6-ae8b-251044de034d tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.184210 Apr 05 13:46:24.379240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 211/454] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:24 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:24.628668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:24.630446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:24.637130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:24.637631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:24.638405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:24.638843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:24.706670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:24.722815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-27a68564-06d2-46d7-a19a-f1d166075269 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.098895 Apr 05 13:46:24.723733 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 244/455] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:24 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:25.126746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:25.127387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:25.133594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.134073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.135687 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.136315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.274391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:25.283732 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:25.285230 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:25.286390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d9b8da29-b545-4618-a4ad-e5338394714c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.164667 Apr 05 13:46:25.286949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 212/456] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:25 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:25.395609 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:25.396147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:25.403355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.403836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.404611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.405043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.548397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:25.555615 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-50162c30-9ebe-4a3b-940e-e0aefa0be536 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.163979 Apr 05 13:46:25.556187 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 245/457] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:25 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:25.635786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-157319680", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1005878422", "security_groups": [{"name": "tempest-secgroup-smoke-827885158"}], "networks": [{"uuid": "9d0b59a5-cdca-47e8-a09b-49bcf22a180c"}], "block_device_mapping_v2": [{"uuid": "d73ede97-4de8-4c6b-958f-db018ffcaf62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:25.742887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:25.744596 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:25.753848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.754744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.756256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:25.756991 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:25.787572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] validate_networks() for [('9d0b59a5-cdca-47e8-a09b-49bcf22a180c', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:46:25.834020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:25.842078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4387deb9-a0af-4721-a038-9012b6d73ad5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.104510 Apr 05 13:46:25.843099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 246/458] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:25 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:26.227708 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:46:26.228128 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:46:26.228788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:46:26.229306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:46:26.229714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:46:26.240209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.240669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.241477 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.241916 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.258565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:46:26.263517 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Getting quotas for user d7f06c5592fd4c7b9883f59c5501049c and project 6d8f6f280f0d454aa7ced0d787929726. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:46:26.310035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:26.310661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:26.317754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.318288 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.319241 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.319729 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.329955 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:46:26.332803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d73ede97-4de8-4c6b-958f-db018ffcaf62',volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:46:26.492938 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9981e0a8-9470-4dae-89d2-a90842e10b4c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.861364 Apr 05 13:46:26.499593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 213/459] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:46:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:46:26.504757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a1048bfd-449a-4b9a-b972-923fa162c5dd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:26.505379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a1048bfd-449a-4b9a-b972-923fa162c5dd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:26.564804 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a1048bfd-449a-4b9a-b972-923fa162c5dd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.565675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.576233 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a1048bfd-449a-4b9a-b972-923fa162c5dd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1088 microversion: 2.1 time: 0.075480 Apr 05 13:46:26.586344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.586344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.586344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-53b41309-00eb-47d9-bd59-0cfa38b3cd6d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.277990 Apr 05 13:46:26.587466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 214/460] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:26 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:26.592143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 247/461] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:26 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:26.593307 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:26.594124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:26.603065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.603647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.604904 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.606154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.851071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.862876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b9bbfb39-f16c-4f96-8eee-4627890e5f57 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.273496 Apr 05 13:46:26.863040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:26.863458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 215/462] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:26 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:26.872646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:26.879512 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.880187 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.881156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:26.881799 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:26.961300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:26.970199 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b1f4f6df-ce3d-481a-a08f-eeead4b77062 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.110374 Apr 05 13:46:26.971745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 248/463] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:26 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:27.593289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:27.594061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:27.601850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.602542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.603212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:27.603781 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.604520 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.605206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:27.611463 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.612093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.612969 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.613527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.678035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:27.686798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8b700c4b-ba7d-4cd1-a20b-0097d6e3fe5c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.097291 Apr 05 13:46:27.688031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 216/464] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:27 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:27.778103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:27.786950 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:27.788535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:27.789936 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4de12d9c-2f07-48bf-91e2-673c1c8b8817 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.191109 Apr 05 13:46:27.790789 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 249/465] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:27 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:27.883778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:27.885110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:27.894201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.895297 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.896441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:27.897201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:27.992680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:27.995053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:28.000304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.000756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.001533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.001974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.078691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.086565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-08a7cc45-f1f9-45f9-b194-7f60b2e549cd tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.209531 Apr 05 13:46:28.097009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 217/466] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:27 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:28.109438 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.116623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4e6c09f7-b0d2-4c78-894b-05fcab340a51 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.127929 Apr 05 13:46:28.117516 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 250/467] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:27 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:28.703545 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:28.704342 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:28.711277 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.712092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.713637 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.714244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.791146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.799073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cc1bf2fe-91ed-4ec9-92ab-957c2c61ca06 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.099325 Apr 05 13:46:28.800144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 218/468] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:28 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:28.815295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:28.816281 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:28.822905 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.823426 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.824323 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:28.824824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:28.965192 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.975297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.977519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:28.979587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cdc08c7f-9c7d-4bb7-8a05-6a6c6e71dda6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.167999 Apr 05 13:46:28.980841 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 251/469] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:28 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:29.108089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:29.108815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:29.118066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.118519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.119537 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.119994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.135622 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:29.136275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:29.146055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.146522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.147342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.147817 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.225099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:29.234278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d6335df7-abea-415c-aef1-2acac6fb11b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.102172 Apr 05 13:46:29.236229 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 252/470] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:29 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:29.295828 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:29.304792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7f005b1e-e7e4-428f-8583-2418766055e7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.204094 Apr 05 13:46:29.305712 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 219/471] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:29 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:29.819624 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:29.820639 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:29.827582 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.828058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.828840 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:29.829269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:29.889915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:29.898859 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-287fafdc-6c41-4dc1-ba9b-604bafc5a340 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.082852 Apr 05 13:46:29.903653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 253/472] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:29 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:30.000526 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:30.001166 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:30.007735 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.008334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.009180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.010156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.168201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.196758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.199940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.201242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9bf3d730-a0e9-467a-8ba4-8ae03e32501c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.206571 Apr 05 13:46:30.202053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 220/473] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:29 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:30.252207 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:30.252787 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:30.258576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.259013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.260317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.260755 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.322169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:30.323316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:30.326116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.333549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c0862700-429a-4736-bb50-df6223e02372 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.085033 Apr 05 13:46:30.340614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.341062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.341853 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.342292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.343437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 254/474] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:30 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:30.491860 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.500272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8d7e1015-55b5-4765-977e-038c77f9f0eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.181934 Apr 05 13:46:30.500843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 221/475] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:30 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:30.916646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:30.917283 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:30.923743 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.924197 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.924964 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:30.925401 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:30.983143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:30.990201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b204766f-2abd-48b7-b04f-f9002e45a571 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.078144 Apr 05 13:46:30.990776 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 255/476] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:30 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:31.219814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:31.220428 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:31.226867 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.227339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.228126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.229164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.350010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:31.350627 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:31.357069 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.357529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.358295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.358734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.361184 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:31.369922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:31.371407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:31.372586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4cde25f5-e65a-4296-9153-019ae0ff802a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.156760 Apr 05 13:46:31.373145 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 222/477] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:31 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:31.424695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:31.433417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-33b4ccc5-e8e9-459c-9a16-abc8de1917a3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.087141 Apr 05 13:46:31.434096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 256/478] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:31 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:31.517394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:31.518007 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:31.524089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.524548 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.525410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:31.526180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:31.668649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:31.676502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b22d229c-bc79-4cdb-8c92-707bf12b38c2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.162867 Apr 05 13:46:31.677068 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 223/479] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:31 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:32.008574 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:32.009362 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:32.016821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.017300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.018137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.018700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.076765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.083849 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b9b87587-ece0-4999-b0f7-efd991b5d9a6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.080026 Apr 05 13:46:32.084416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 257/480] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:32 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:32.393414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:32.394013 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:32.401115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.401838 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.402978 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.403490 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.450744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:32.451382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:32.457873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.458363 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.459144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.459659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.580683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.592718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-044b73dd-851b-4330-ae7f-f77b33c36471 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1250 microversion: 2.1 time: 0.146334 Apr 05 13:46:32.597456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 258/481] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:32 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1250 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:32.619341 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.628644 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.630270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.631602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7d6bcfec-bb64-45ac-a995-05126c6aecf5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.242007 Apr 05 13:46:32.632169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 224/482] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:32 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:32.693588 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:32.694177 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:32.700100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.700541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.701285 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:32.701714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:32.834946 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:32.843132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e1d03eff-7fa9-4c40-9db6-315b094df697 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.153329 Apr 05 13:46:32.843736 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 259/483] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:32 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:33.101730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:33.102273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:33.109031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.109605 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.110259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.110697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.180632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:33.189833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-aee68d1d-8be1-451d-84f9-a89e692cd7c0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1138 microversion: 2.1 time: 0.091511 Apr 05 13:46:33.199656 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 225/484] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:33 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1138 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:33.614632 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:33.615238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:33.622122 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.622572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.623329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.623801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.650106 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:33.650821 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:33.657381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.657839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.658621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.659066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.685967 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:33.693507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e37ff18c-0edd-40cf-8aae-6f92cb43bac3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1298 microversion: 2.1 time: 0.082677 Apr 05 13:46:33.694088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 260/485] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:33 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:33.795583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:33.803979 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:33.805482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:33.807459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f32f9413-b333-4138-b0af-a3858ab46709 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.160429 Apr 05 13:46:33.808114 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 226/486] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:33 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:33.860347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:33.861105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:33.866851 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.867298 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:33.868089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:33.870154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.206754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:34.207358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:34.214304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.214755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.215551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.215988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.279194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:34.286601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1709f34e-32fc-4816-bd30-78c14ec7ad37 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1204 microversion: 2.1 time: 0.083662 Apr 05 13:46:34.287176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 227/487] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:34 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:34.561213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:34.568325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d527182b-2ea1-409a-abee-b78e25b541eb tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.711816 Apr 05 13:46:34.568898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 261/488] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:33 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:34.710186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:34.710835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:34.717673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.718129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.718905 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.719346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.779551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:34.786887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec1945a4-1326-464d-be91-0e5d546df178 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1304 microversion: 2.1 time: 0.080589 Apr 05 13:46:34.787506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 228/489] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:34 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:34.826506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:34.827126 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:34.833035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.833479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:34.834243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:34.834675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.237456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.247162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.248680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.249834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a58eec99-1da9-4c08-a252-73f64f7b830c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.428087 Apr 05 13:46:35.260948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 262/490] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:34 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:35.304602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:35.305330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:35.311997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.312519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.313287 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.313752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.380403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.394325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c40f7a0c-edf8-40f6-81f9-3076415b18c5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1204 microversion: 2.1 time: 0.093497 Apr 05 13:46:35.395107 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 229/491] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:35 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:35.585985 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:35.586594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:35.592910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.593357 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.594123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.594554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.805115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:35.805805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:35.811896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.812359 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.813218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:35.813664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:35.959152 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.971201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f2da3936-3ba6-4faa-992c-67f0186a4cf3 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.388710 Apr 05 13:46:35.972468 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 263/492] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:35 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:35.991459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:35.999449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-92fc38ab-368c-45ee-9fc4-6356a5505be4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.198729 Apr 05 13:46:36.000064 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 230/493] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:35 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:36.268394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:36.268997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:36.274751 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.275834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:36.276634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.277054 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:36.406871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:36.411141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:36.411776 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:36.415141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:36.416795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:36.417650 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.418098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:36.418228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fdf89f3f-c5f2-4599-b18f-93922497b8ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.153635 Apr 05 13:46:36.418697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 264/494] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:36 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:36.418855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.419298 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:36.562106 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:36.569458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a75ddad-d8d5-4bfa-a19d-f96d6ab3e137 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1271 microversion: 2.1 time: 0.162155 Apr 05 13:46:36.570136 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 231/495] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:36 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:36.990079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:36.990665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:36.997567 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.998009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:36.998763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:36.999191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.016449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:37.017215 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:37.023388 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.023982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.024846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.025682 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.163139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:37.173594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3539e43c-8d89-462b-a9c3-47c0bce75db9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.160729 Apr 05 13:46:37.174294 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 232/496] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:37 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:37.403856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:37.411374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e6a189cf-a2ab-4e8e-b136-c411dafc4eb6 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.425035 Apr 05 13:46:37.412055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 265/497] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:36 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:37.438141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:37.438748 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:37.444471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.445272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.445665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.446092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.589754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:37.590791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:37.603178 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:37.608083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.608848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.609988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.610624 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.611915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:37.613507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:37.614560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d45d4d35-325c-4ac0-8f2d-5456f63318ec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.180391 Apr 05 13:46:37.615551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 233/498] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:37 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:37.648803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}, {"name": "network-changed", "server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:37.662832 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:37.663701 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:37.680420 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] Creating event network-changed:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:46:37.681223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] Creating event network-changed:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:46:37.694684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-c880a761-f80c-45f4-bb55-e7580f5bd813 req-e47f5a4a-ffba-472c-89d4-b2454e901fe7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050199 Apr 05 13:46:37.696355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 234/499] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:46:38.191965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:38.192653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:38.200253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.200709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.201496 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.201930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.204040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.211529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-301d3d5b-2054-4a54-be33-11c49b03140c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1271 microversion: 2.1 time: 0.628416 Apr 05 13:46:38.212129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 266/500] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:37 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1271 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:38.341516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.348745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-409c5d5d-7f5a-49c1-8c47-dfeea76d34c2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.161513 Apr 05 13:46:38.349304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 235/501] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:38 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:38.429045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:38.429681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:38.436680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.437129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.437893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.438327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.603838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.611103 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4de8f025-5446-48b0-8f70-2a6fae4852cc tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.185972 Apr 05 13:46:38.611685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 267/502] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:38 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:38.632839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:38.633452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:38.639248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.639745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.640516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:38.640958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:38.783514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.792422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.793922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:38.795080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0a6c0ebc-a249-425f-8829-8f524980807d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.166224 Apr 05 13:46:38.795666 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 236/503] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:38 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:39.228941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:39.229587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:39.235802 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.236252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.237010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.237443 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.366232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:39.366914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:39.374026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.374470 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.374593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.375244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.375715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.381754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d4894c03-f174-4b49-8c9c-76ab055f6ade tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1271 microversion: 2.1 time: 0.157113 Apr 05 13:46:39.382324 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 268/504] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:39 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:39.506115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.515081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-28d17179-22d7-4f5e-a247-8a4003ec2886 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.152650 Apr 05 13:46:39.515704 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 237/505] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:39 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:39.627916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:39.628784 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:39.635396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.635970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.636740 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.637561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.770294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.777701 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-62e47d46-bb57-4a00-8352-a8a634dd3091 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.153782 Apr 05 13:46:39.778275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 269/506] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:39 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:39.815440 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:39.816089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:39.824398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.824902 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.825726 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:39.826168 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:39.968281 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.976740 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.978875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:39.980076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-11dba1d5-be2e-4967-97bb-dbe986cc89c7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.170298 Apr 05 13:46:39.980647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 238/507] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:39 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:40.398432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:40.399044 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:40.406342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.406790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.407724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.408034 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.532471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:40.533255 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:40.539575 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.540037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.540980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.541437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.674474 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:40.682960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c96933c1-157a-4f56-af67-6f080a525cca tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1271 microversion: 2.1 time: 0.288335 Apr 05 13:46:40.683880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 270/508] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:40 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:40.684723 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:40.693737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5410a57a-1bb9-4505-ace9-996a9b81f957 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.165084 Apr 05 13:46:40.694311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 239/509] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:40 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:40.793986 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:40.794608 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:40.800347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.800797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.801564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.801998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.834585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:40.835462 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:40.841665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.842190 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.843021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:40.843526 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:40.938221 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:40.945631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ff9fceec-4023-49b8-a119-769489ed41df tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.155502 Apr 05 13:46:40.946209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 271/510] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:40 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:40.982706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:40.995275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a3eaea38-edc4-462d-b93d-f5dbfe87c989 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1594 microversion: 2.1 time: 0.164381 Apr 05 13:46:40.995905 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 240/511] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:40 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:41.002048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:41.002844 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:41.011429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.011909 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.012714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.013154 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.180363 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:41.190064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:41.191918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:41.193089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9ecc943c-abae-46e1-aa6c-7fb6b402b3ae tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.195301 Apr 05 13:46:41.193656 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 272/512] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:40 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:41.702578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:41.704299 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:41.711259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:41.713053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:41.714115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.714689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.715631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.716182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.728752 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.729952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.730907 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.731683 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.901771 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:41.911948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-40b21300-74b4-4a11-be9b-6704a54411e8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1271 microversion: 2.1 time: 0.215558 Apr 05 13:46:41.912857 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 241/513] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:41 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:41.918162 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-0997dc33-9254-41d0-98a6-cc0892494f77 req-2fe698bd-42ec-43d1-b04a-8a85d7e4c574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738d62fc-2132-4bd8-bffd-08a3cf89dfca", "name": "network-vif-plugged", "status": "completed", "tag": "e10f2b70-8b96-425c-a38d-25644b3add9f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:41.927357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-0997dc33-9254-41d0-98a6-cc0892494f77 req-2fe698bd-42ec-43d1-b04a-8a85d7e4c574 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.928922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-0997dc33-9254-41d0-98a6-cc0892494f77 req-2fe698bd-42ec-43d1-b04a-8a85d7e4c574 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.940274 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-0997dc33-9254-41d0-98a6-cc0892494f77 req-2fe698bd-42ec-43d1-b04a-8a85d7e4c574 service nova] Creating event network-vif-plugged:e10f2b70-8b96-425c-a38d-25644b3add9f for instance 738d62fc-2132-4bd8-bffd-08a3cf89dfca on hv-cinder-83587 Apr 05 13:46:41.947725 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-0997dc33-9254-41d0-98a6-cc0892494f77 req-2fe698bd-42ec-43d1-b04a-8a85d7e4c574 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032745 Apr 05 13:46:41.948641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 242/514] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:41.963308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:41.964040 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:41.970385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.970844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:41.971663 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:41.972284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:42.113432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:42.120879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9e63b737-a323-44b4-ae12-937b32587d63 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.162503 Apr 05 13:46:42.130468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 243/515] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:41 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:42.196339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:42.209575 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c707cd37-d24c-4145-a604-5ed1ea0fb805 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.501905 Apr 05 13:46:42.215437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:42.216354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:42.220294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 273/516] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:41 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:42.232801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:42.233248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:42.234619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:42.235060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:42.374445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:42.383098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:42.385281 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:42.386476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dad24c7a-6055-460a-be6b-d67abc372275 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.177101 Apr 05 13:46:42.387236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 244/517] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:42 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:42.933020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:42.936926 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:42.943835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:42.944395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:42.945477 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:42.946017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.138220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:43.138805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:43.145511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.146005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.146778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.147245 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.284557 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.292008 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-56162719-c53d-47a5-901e-891e2f9b8369 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.157762 Apr 05 13:46:43.292586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 245/518] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:43 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:43.297785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:43.298577 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:43.307903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.308358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.309132 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.309572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.453240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.460497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-144fe954-0dcd-4fff-823a-110d494d381f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.166942 Apr 05 13:46:43.461141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 246/519] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:43 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:43.466160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:43.466773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:43.472394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.472851 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.473613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.474047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.579949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.590183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-32fcfa9f-0c0c-4c77-bc75-63e5489bf73d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.664205 Apr 05 13:46:43.604107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 274/520] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:42 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:43.626081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.635164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.636937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:43.638191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-62c7f79c-412f-419c-97d9-b328185a2f52 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.176199 Apr 05 13:46:43.639036 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 247/521] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:43 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:43.955217 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-af854870-7483-4f8b-84d2-ba8a55ba3bd0 req-2ae9cb95-2e6b-4a26-8321-ac6e7f17c114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:43.970464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-af854870-7483-4f8b-84d2-ba8a55ba3bd0 req-2ae9cb95-2e6b-4a26-8321-ac6e7f17c114 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:43.974286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-af854870-7483-4f8b-84d2-ba8a55ba3bd0 req-2ae9cb95-2e6b-4a26-8321-ac6e7f17c114 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:43.989175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-af5d6093-ae61-4c80-9cff-c08236470008 req-70eaf4b0-bd94-4359-a38e-6d983f7932cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "name": "network-vif-plugged", "status": "completed", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:44.004616 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-af5d6093-ae61-4c80-9cff-c08236470008 req-70eaf4b0-bd94-4359-a38e-6d983f7932cf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.008259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-af854870-7483-4f8b-84d2-ba8a55ba3bd0 req-2ae9cb95-2e6b-4a26-8321-ac6e7f17c114 service nova] Creating event network-changed:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:46:44.008658 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-af5d6093-ae61-4c80-9cff-c08236470008 req-70eaf4b0-bd94-4359-a38e-6d983f7932cf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.024137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-af854870-7483-4f8b-84d2-ba8a55ba3bd0 req-2ae9cb95-2e6b-4a26-8321-ac6e7f17c114 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072642 Apr 05 13:46:44.027578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 275/522] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:44.032579 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-af5d6093-ae61-4c80-9cff-c08236470008 req-70eaf4b0-bd94-4359-a38e-6d983f7932cf service nova] Creating event network-vif-plugged:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:46:44.038050 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-af5d6093-ae61-4c80-9cff-c08236470008 req-70eaf4b0-bd94-4359-a38e-6d983f7932cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054695 Apr 05 13:46:44.038924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 248/523] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:44.311048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:44.312587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:44.322440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.322920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.323789 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.324708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.346418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:46:44.347176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 13:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:46:44.479631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:44.480644 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:44.492260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.493025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.495183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.495839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.636294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:44.644980 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e7ed89c7-cddc-416e-844b-be7fdeaf7021 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1313 microversion: 2.1 time: 0.339021 Apr 05 13:46:44.646255 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 276/524] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:44 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:44.653314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:44.654135 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:44.660498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.660941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.661710 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.662471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.812646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:44.820834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a87a9fb5-6ac4-4efb-ac1c-12f4de4d4e50 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.173035 Apr 05 13:46:44.831158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 277/525] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:44 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:44.831158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:44.831158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:44.836657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.837416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.838745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:44.839350 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:44.979667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:44.991527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-188d4a4e-5d18-4b05-9cb8-0a4250471e87 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.516446 Apr 05 13:46:44.992876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 249/526] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:44 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:45.347941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-994863350"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:45.350104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:45.357276 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.357729 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.358514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.358951 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.387115 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:45.400520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:45.402040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:45.403791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1d4e23f7-7c73-45a6-b434-e92f2ad1d5d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.580150 Apr 05 13:46:45.404357 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 278/527] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:44 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:45.497725 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.network.security_group_api [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Adding security group fa4bd02d-8e2d-4bf4-95f5-98fa20f0115a to port b68cef7c-d9bf-494a-be42-2c1584ca80e8 Apr 05 13:46:45.662218 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:45.663090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:45.669677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.670404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.671179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.671871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.869621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-73a0d683-f009-4a29-97dc-3675d03fe2fa tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action" status: 202 len: 0 microversion: 2.1 time: 0.525516 Apr 05 13:46:45.870237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 250/528] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:46:45 2022] POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:46:45.875185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:45.875830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:45.885928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:45.894549 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.895013 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.898396 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.898686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.900874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-741eecff-eb12-49dd-a09a-cdc5ed87ebc7 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1497 microversion: 2.1 time: 0.242371 Apr 05 13:46:45.903648 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 279/529] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:45 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:45.913035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:45.913547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:45.938573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.939021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:45.939834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:45.940270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.120161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.131705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-649ed685-9146-4df0-97a0-e4aaf2570bf6 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.260042 Apr 05 13:46:46.134967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 251/530] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:45 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:46.145519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2a9c30bc-ab98-4e8f-96c5-0efb6d22e708 req-c745c3a6-b6e4-4f36-999f-156c2ef8967a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:46.168055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2a9c30bc-ab98-4e8f-96c5-0efb6d22e708 req-c745c3a6-b6e4-4f36-999f-156c2ef8967a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.168477 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2a9c30bc-ab98-4e8f-96c5-0efb6d22e708 req-c745c3a6-b6e4-4f36-999f-156c2ef8967a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.182755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2a9c30bc-ab98-4e8f-96c5-0efb6d22e708 req-c745c3a6-b6e4-4f36-999f-156c2ef8967a service nova] Creating event network-changed:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:46:46.188979 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2a9c30bc-ab98-4e8f-96c5-0efb6d22e708 req-c745c3a6-b6e4-4f36-999f-156c2ef8967a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052811 Apr 05 13:46:46.190065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 252/531] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:46.195630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:46.196560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:46.204099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.204810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.205599 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.206120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.220402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.230836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ff02428-70ee-4a66-9b76-495abc0e71a0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1640 microversion: 2.1 time: 0.321269 Apr 05 13:46:46.231431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 280/532] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:45 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1640 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:46.243670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-612ca788-487c-4185-b96a-89ece354c93f req-e664dda4-7616-4cfa-9532-078b52d4b7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "name": "network-vif-plugged", "status": "completed", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:46.258480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-612ca788-487c-4185-b96a-89ece354c93f req-e664dda4-7616-4cfa-9532-078b52d4b7c7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.259095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-612ca788-487c-4185-b96a-89ece354c93f req-e664dda4-7616-4cfa-9532-078b52d4b7c7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.278035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-612ca788-487c-4185-b96a-89ece354c93f req-e664dda4-7616-4cfa-9532-078b52d4b7c7 service nova] Creating event network-vif-plugged:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:46:46.285558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-612ca788-487c-4185-b96a-89ece354c93f req-e664dda4-7616-4cfa-9532-078b52d4b7c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048481 Apr 05 13:46:46.286305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 281/533] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:46.368948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.376350 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9dd8f9d1-5d3f-44b3-bc84-c0140d1fee26 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.184886 Apr 05 13:46:46.376915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 253/534] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:46 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:46.424498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:46.425206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:46.431585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.432037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.432864 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.433323 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.532122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:46.533261 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:46.544862 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.544862 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.548608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.549074 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.585582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:46:46.685010 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7c7a4ee6-79a7-49e6-8d46-b6b5f0777010 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 204 len: 0 microversion: 2.1 time: 0.158907 Apr 05 13:46:46.686223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 254/535] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:46:46 2022] DELETE /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 13:46:46.695037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:46.695887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:46.704521 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.704968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.705801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:46.706432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:46.718519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.728096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.729621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.730899 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e0b7a778-1219-4305-9736-1e9b368df815 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.311666 Apr 05 13:46:46.731463 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 282/536] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:46 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:46.846685 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:46.855374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-23f69ece-f58a-40e8-b87b-e67a380d7eaa tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1503 microversion: 2.1 time: 0.164988 Apr 05 13:46:46.855981 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 255/537] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:46 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:47.152025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:47.152812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:47.159123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.159598 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.160351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.160780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.295769 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:47.303039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-91a654e7-777f-4891-b960-a6f201501b08 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.155670 Apr 05 13:46:47.303637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 283/538] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:47 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:47.393099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:47.393707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:47.399542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.400895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.401772 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.402222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.534269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:47.541890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-75c30b06-6226-4f23-86b6-2bcbf9f8df6d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.152704 Apr 05 13:46:47.542458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 256/539] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:47 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:47.749458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:47.750063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:47.755963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.756413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.757173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.757610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.872972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:47.873695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:47.879945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.880467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.881332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:47.881835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:47.891828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:47.900497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:47.902002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:47.903160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0b946b51-c15f-4d17-a9cd-3b40da22c31f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.157595 Apr 05 13:46:47.903759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 284/540] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:47 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:46:48.019349 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:48.026974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-03227ac0-3170-4920-8e78-648c1bb4b41b tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1503 microversion: 2.1 time: 0.158328 Apr 05 13:46:48.027590 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 257/541] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:47 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:48.320400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:48.321012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:48.327876 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.328326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:48.329089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.329526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:48.466903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:48.474341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1a46a8c0-7f7f-42bb-9fe7-140dae941831 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.157695 Apr 05 13:46:48.474928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 285/542] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:48 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:48.558326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:48.559048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:48.565794 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.566359 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:48.567317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.567981 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:48.705495 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:48.713345 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-08c59fb3-db20-4a8b-a99c-cc226d7e1669 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.159255 Apr 05 13:46:48.713911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 258/543] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:48 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:48.921401 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:48.922010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:48.927861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.928215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:48.928981 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:48.929417 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.045333 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:49.046032 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:49.053556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.054116 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.054972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.055626 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.075090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.084212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.086078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.087356 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c331e846-1816-4532-bf74-20aeeceb2b14 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1809 microversion: 2.20 time: 0.169699 Apr 05 13:46:49.095342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 286/544] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:48 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:49.200114 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.207654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5d7cd369-9e16-48b2-9572-ac87d88cdf66 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1503 microversion: 2.1 time: 0.166331 Apr 05 13:46:49.208225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 259/545] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:49 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:49.492411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:49.493021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:49.500416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.501231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.502445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.502888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.639073 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.646373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0a77dee6-57c9-4825-b638-d815fcb8ebc0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.157787 Apr 05 13:46:49.646942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 287/546] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:49 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:49.730759 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:49.731367 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:49.737177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.737628 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.738390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:49.738825 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:49.877609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:49.884834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-02ea8ead-e5f7-4f7f-8cce-9578431078d9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.158695 Apr 05 13:46:49.885393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 260/547] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:49 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:50.107279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:50.107864 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:50.114726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.115195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.116008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.116436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.225418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:50.226026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:50.232702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.233154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.233926 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.234364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.272201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:50.281325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:50.282814 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:50.284006 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-31363e7c-9911-4790-a9d6-98dedb287fc4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1796 microversion: 2.20 time: 0.181546 Apr 05 13:46:50.284564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 288/548] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:46:50 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1796 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:46:50.374715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:50.382166 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8c7c88d6-100d-463e-9291-e1c7ca59b6f2 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1503 microversion: 2.1 time: 0.161103 Apr 05 13:46:50.382729 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 261/549] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:50 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:50.662852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:50.663459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:50.669790 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.670239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.670998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.671430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.804285 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:50.818266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-56800e72-67e4-43a7-bd87-b67ed7aeb136 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.158730 Apr 05 13:46:50.819280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 289/550] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:50 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:50.901570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:50.902112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:50.907968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.908411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:50.909165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:50.909598 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:51.048698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:51.058657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5b8bb3a0-8222-48d4-bb92-e80fec7cfcc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1371 microversion: 2.1 time: 0.160829 Apr 05 13:46:51.059482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 262/551] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:50 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:51.400101 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:51.401012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:51.407195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:51.407691 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:51.408466 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:51.408903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:51.757924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0448d4373e2c48da82192343ce414f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f065b9be718746fe906f667735f52b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:51.765920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3103be0d-14e1-4d1d-8d42-2769af2ad601 tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 200 len: 1503 microversion: 2.1 time: 0.370229 Apr 05 13:46:51.766502 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 290/552] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:51 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:51.842354 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:51.843121 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:51.849760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:51.850292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:51.851403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:51.851930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:51.989861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:51.998669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fb97f046-f392-47bd-80b1-5009618c349e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.160456 Apr 05 13:46:51.999249 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 263/553] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:51 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:52.016557 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-99f3e920-1b56-48fc-a07e-7a6620005fb7 req-b1acb7b3-6fa5-4616-8f48-51cc317cecaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738d62fc-2132-4bd8-bffd-08a3cf89dfca", "name": "network-vif-deleted", "tag": "e10f2b70-8b96-425c-a38d-25644b3add9f"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:52.026351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-99f3e920-1b56-48fc-a07e-7a6620005fb7 req-b1acb7b3-6fa5-4616-8f48-51cc317cecaf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.026955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-99f3e920-1b56-48fc-a07e-7a6620005fb7 req-b1acb7b3-6fa5-4616-8f48-51cc317cecaf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.038764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-99f3e920-1b56-48fc-a07e-7a6620005fb7 req-b1acb7b3-6fa5-4616-8f48-51cc317cecaf service nova] Creating event network-vif-deleted:e10f2b70-8b96-425c-a38d-25644b3add9f for instance 738d62fc-2132-4bd8-bffd-08a3cf89dfca on hv-cinder-83587 Apr 05 13:46:52.043928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-99f3e920-1b56-48fc-a07e-7a6620005fb7 req-b1acb7b3-6fa5-4616-8f48-51cc317cecaf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Apr 05 13:46:52.044613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 291/554] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:52.076067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:52.076796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:52.082823 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.083358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.084271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.084778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.228334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:52.235466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-25a08feb-281b-473a-b0b3-a320f18c9d14 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1564 microversion: 2.1 time: 0.163970 Apr 05 13:46:52.236248 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 264/555] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:52 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:52.252836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:52.253427 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:52.260001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.260447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.261207 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.261641 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.342945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7d6ba7d6-277f-43d7-a6ff-3a4df6763188 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094261 Apr 05 13:46:52.343573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 292/556] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:46:52 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:52.783789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:52.784305 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] [instance: 738d62fc-2132-4bd8-bffd-08a3cf89dfca] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:52.789997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.790936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.791783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:52.792160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:52.805283 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] HTTP exception thrown: Instance 738d62fc-2132-4bd8-bffd-08a3cf89dfca could not be found. Apr 05 13:46:52.806602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] Returning 404 to user: Instance 738d62fc-2132-4bd8-bffd-08a3cf89dfca could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:46:52.807427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-64660e50-2218-4201-8044-6680af89845f tempest-VolumesActionsTest-1572975503 tempest-VolumesActionsTest-1572975503-project] 10.222.0.59 "GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca" status: 404 len: 111 microversion: 2.1 time: 0.027703 Apr 05 13:46:52.807987 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 265/557] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:52 2022] GET /compute/v2.1/servers/738d62fc-2132-4bd8-bffd-08a3cf89dfca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:46:53.017589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:53.018399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:53.025090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:53.025625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:53.026504 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:53.027053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:53.179883 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:53.187587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-833864be-6663-445e-909d-4415545c2a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.175984 Apr 05 13:46:53.188462 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 293/558] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:53 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:53.416087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-02f25fd7-f16b-41c9-a40d-8a342b5f3389 req-d7f81fc8-8353-4f9e-9407-49c3b9533b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:53.425119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-02f25fd7-f16b-41c9-a40d-8a342b5f3389 req-d7f81fc8-8353-4f9e-9407-49c3b9533b55 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:53.425561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-02f25fd7-f16b-41c9-a40d-8a342b5f3389 req-d7f81fc8-8353-4f9e-9407-49c3b9533b55 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:53.436471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-02f25fd7-f16b-41c9-a40d-8a342b5f3389 req-d7f81fc8-8353-4f9e-9407-49c3b9533b55 service nova] Creating event network-changed:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:46:53.441846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-02f25fd7-f16b-41c9-a40d-8a342b5f3389 req-d7f81fc8-8353-4f9e-9407-49c3b9533b55 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030576 Apr 05 13:46:53.442429 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 266/559] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:46:54.204304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:54.204916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:54.210718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:54.211167 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:54.212011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:54.213280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:54.357052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:54.364631 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0657539f-f6a2-44f9-b625-b0f62c67a36b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.164308 Apr 05 13:46:54.365434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 294/560] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:54 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:55.383157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:55.384426 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:55.390562 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:55.391007 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:55.391790 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:55.392222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:55.531525 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:55.538809 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fa421b67-9570-4836-9921-4ae8b9c10d40 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.160312 Apr 05 13:46:55.539366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 267/561] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:55 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:56.557291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:56.557892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:56.564127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:56.564573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:56.565326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:56.565757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:56.705465 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:56.712971 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-145144c4-0ef3-403d-8466-b251511a82aa tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.160142 Apr 05 13:46:56.713548 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 295/562] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:56 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:46:57.731805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:57.733096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:57.741526 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:57.741976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:57.742848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:57.743405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:57.937124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:57.947108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-18d168fe-aa64-4741-937d-9a1eb5d40a46 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.220300 Apr 05 13:46:57.948039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 268/563] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:57 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:46:58.770336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-6ec44b35-ac6d-4e3a-aea4-f0cd72e1b288 req-a40039dd-5fa7-43f7-afa6-2b8eee390fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "name": "network-vif-plugged", "status": "completed", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:46:58.782340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6ec44b35-ac6d-4e3a-aea4-f0cd72e1b288 req-a40039dd-5fa7-43f7-afa6-2b8eee390fe7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:58.783420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6ec44b35-ac6d-4e3a-aea4-f0cd72e1b288 req-a40039dd-5fa7-43f7-afa6-2b8eee390fe7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:58.795593 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-6ec44b35-ac6d-4e3a-aea4-f0cd72e1b288 req-a40039dd-5fa7-43f7-afa6-2b8eee390fe7 service nova] Creating event network-vif-plugged:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:46:58.801369 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-6ec44b35-ac6d-4e3a-aea4-f0cd72e1b288 req-a40039dd-5fa7-43f7-afa6-2b8eee390fe7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035719 Apr 05 13:46:58.802999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 296/564] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:46:58.965910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:46:58.967309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:46:58.976989 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:58.978598 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:58.979885 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:46:58.981291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:46:59.142075 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:46:59.151086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5a907e7c-0692-44d6-93b9-2f50a2564d6a tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.189924 Apr 05 13:46:59.160641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 269/565] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:46:58 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:00.168518 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:00.169234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:00.176182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:00.176904 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:00.177691 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:00.178129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:00.355301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:00.364046 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d670b335-bbe8-4757-a753-78b5a68880c1 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1259 microversion: 2.1 time: 0.199752 Apr 05 13:47:00.365830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 297/566] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:00 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:01.382664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:01.384456 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:01.393139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:01.393684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:01.394799 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:01.395403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:01.554595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:01.565847 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9cbbf40c-a27c-434e-93e1-08c6457c1757 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1443 microversion: 2.1 time: 0.187163 Apr 05 13:47:01.567128 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 270/567] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:01 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1443 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:01.584032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:01.584688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:01.592374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:01.592888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:01.593891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:01.594554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:01.741305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:01.751063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1a79a90-d4a9-4457-a3d4-d5ab4c8a3a94 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1443 microversion: 2.1 time: 0.170791 Apr 05 13:47:01.763112 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 298/568] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:01 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1443 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:03.756562 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-f0735961-7fee-4abe-9dcf-af99b35531fd req-c23bbb37-8b9a-4fc2-8cb1-e96afc64d417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:03.766632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f0735961-7fee-4abe-9dcf-af99b35531fd req-c23bbb37-8b9a-4fc2-8cb1-e96afc64d417 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:03.767424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f0735961-7fee-4abe-9dcf-af99b35531fd req-c23bbb37-8b9a-4fc2-8cb1-e96afc64d417 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:03.780104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-f0735961-7fee-4abe-9dcf-af99b35531fd req-c23bbb37-8b9a-4fc2-8cb1-e96afc64d417 service nova] Creating event network-changed:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:47:03.786408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-f0735961-7fee-4abe-9dcf-af99b35531fd req-c23bbb37-8b9a-4fc2-8cb1-e96afc64d417 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033838 Apr 05 13:47:03.787304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 271/569] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:15.503587 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:15.504537 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.512080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.512277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.513040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.513479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.585364 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1e7d890b-7c0f-4a1d-9cf0-67addaa1dc8b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action" status: 202 len: 0 microversion: 2.1 time: 0.085456 Apr 05 13:47:15.587434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 299/570] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:47:15 2022] POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:47:15.600503 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:15.603301 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.612458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:15.613577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.620752 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.621210 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.621990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.622429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.624617 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.625092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.625893 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.626363 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.649163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3ea71187-ad9a-4230-84af-098135fb9cca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/ips" status: 200 len: 151 microversion: 2.1 time: 0.041009 Apr 05 13:47:15.655402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 300/571] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:47:15 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:15.661608 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "643961cd-3214-4523-af9b-da15269215d1"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:15.662732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.674343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.674788 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.675591 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.676027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.775076 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Invalid volume: volume 643961cd-3214-4523-af9b-da15269215d1 is already attached to instances: 3dcf398b-babb-4847-a7f6-19219fca641e Apr 05 13:47:15.775698 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 400 to user: Invalid volume: volume 643961cd-3214-4523-af9b-da15269215d1 is already attached to instances: 3dcf398b-babb-4847-a7f6-19219fca641e {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:47:15.776620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9f940093-4d3e-4bc5-89ee-8a9f09f82827 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119732 Apr 05 13:47:15.779555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 301/572] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:47:15 2022] POST /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:47:15.786058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:15.786553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.792781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.793230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.794017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.794451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.811741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:15.819688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-91784836-9be3-454b-bd1a-72f085176876 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1751 microversion: 2.1 time: 0.227685 Apr 05 13:47:15.820272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 272/573] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:15 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:15.827705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:47:15.906402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-352ad960-31a3-454e-bb0e-cf01e446fa0b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 204 len: 0 microversion: 2.1 time: 0.123567 Apr 05 13:47:15.906991 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 302/574] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:47:15 2022] DELETE /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:47:15.915434 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:15.916343 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:15.922502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.922979 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:15.923792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:15.924228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:16.067100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:16.075270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bcb487a2-969e-4903-a499-e37e47791626 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1683 microversion: 2.1 time: 0.163859 Apr 05 13:47:16.082695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 273/575] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:15 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:16.838246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:16.838943 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:16.845213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:16.845655 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:16.846416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:16.846848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:16.999432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:17.007068 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-572be20c-0ee8-4d0f-a336-76c54731382f tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1751 microversion: 2.1 time: 0.173212 Apr 05 13:47:17.007651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 303/576] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:16 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:17.093148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:17.093674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:17.099972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:17.100425 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:17.101439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:17.101882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:17.235258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:17.243209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec937a80-ea50-402e-bb8e-64d55e4cd937 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1683 microversion: 2.1 time: 0.153466 Apr 05 13:47:17.243981 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 274/577] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:17 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:18.025172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:18.025771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:18.031979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:18.032478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:18.033178 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:18.033611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:18.262951 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:18.264405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:18.271348 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:18.271934 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:18.272799 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:18.273307 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:18.332872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:18.344577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1f87488f-01f0-42f1-ba58-76396303710a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.324009 Apr 05 13:47:18.346519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 304/578] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:18 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:18.416713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:18.424247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ce9b1402-3177-4377-a971-10e8e5cb4413 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 200 len: 1683 microversion: 2.1 time: 0.167003 Apr 05 13:47:18.424822 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 275/579] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:18 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:18.738600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-b1f5e0a4-71e4-4868-bc75-a1c60e83db54 req-ef99e58c-82a8-445c-a2b2-9802fc85e565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347", "name": "network-vif-deleted", "tag": "0b8b738b-1903-4b5f-b33b-44e6534a54e6"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:18.749803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b1f5e0a4-71e4-4868-bc75-a1c60e83db54 req-ef99e58c-82a8-445c-a2b2-9802fc85e565 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:18.750304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b1f5e0a4-71e4-4868-bc75-a1c60e83db54 req-ef99e58c-82a8-445c-a2b2-9802fc85e565 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:18.763244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-b1f5e0a4-71e4-4868-bc75-a1c60e83db54 req-ef99e58c-82a8-445c-a2b2-9802fc85e565 service nova] Creating event network-vif-deleted:0b8b738b-1903-4b5f-b33b-44e6534a54e6 for instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 on hv-cinder-83587 Apr 05 13:47:18.769107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-b1f5e0a4-71e4-4868-bc75-a1c60e83db54 req-ef99e58c-82a8-445c-a2b2-9802fc85e565 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034215 Apr 05 13:47:18.769716 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 305/580] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:19.364858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:19.365667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:19.373416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:19.373864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:19.374887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:19.375330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:19.444921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:19.446290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:19.454880 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:19.456101 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:19.457244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:19.457877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:19.474008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. Apr 05 13:47:19.474838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:47:19.483225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aca4e243-a85c-4e5b-b888-50f31b9743e5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 404 len: 111 microversion: 2.1 time: 0.037788 Apr 05 13:47:19.484564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 306/581] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:19 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:47:19.493295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7904eab4-af88-45ef-b541-a49bd2b85b58 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '.version_select at 0x7f9bfd917c10>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:19.514843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7904eab4-af88-45ef-b541-a49bd2b85b58 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097392087" status: 202 len: 0 microversion: 2.1 time: 0.026193 Apr 05 13:47:19.515865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 307/582] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Apr 5 13:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097392087 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:47:19.558032 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:19.568160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6b6d81ec-b8cf-4928-8d10-ab5d3185e844 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.208177 Apr 05 13:47:19.568744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 276/583] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:19 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:20.239596 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:20.240086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:20.246960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.247406 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.248262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.248699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.371613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lazy-loading 'services' on Instance uuid 3dcf398b-babb-4847-a7f6-19219fca641e {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:47:20.483290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a5ca897-c800-4438-981e-728ba9a78b49 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments/643961cd-3214-4523-af9b-da15269215d1" status: 202 len: 0 microversion: 2.1 time: 0.247575 Apr 05 13:47:20.483984 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 308/584] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:47:20 2022] DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments/643961cd-3214-4523-af9b-da15269215d1 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:47:20.493539 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:20.494648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:20.501386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.502129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.503034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.503589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.535125 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5fe0bb94-b24e-4ae1-ae49-dfd6d316800e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Apr 05 13:47:20.536040 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 277/585] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:47:20 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:20.586563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:20.587846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:20.593890 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.594408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.595230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:20.595755 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:20.747758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:20.756017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bfb6d46f-b037-422c-9d14-2b5e73273df2 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.174381 Apr 05 13:47:20.756780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 309/586] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:20 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:21.546612 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:21.547848 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:21.555360 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.555845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.556639 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.557069 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.591511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dc38be2e-ec66-423a-9078-4a22d42a55fa tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048795 Apr 05 13:47:21.592112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 278/587] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:47:21 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:47:21.654189 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:21.654801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:21.661203 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.661651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.662430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.662869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.689639 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:47:21.771806 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b98620ee-e835-4cc3-9a49-af778e9462d2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 204 len: 0 microversion: 2.1 time: 0.122057 Apr 05 13:47:21.772714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 310/588] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:47:21 2022] DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:47:21.777542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:21.778819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:21.784402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:21.785084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:21.786538 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.787208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.788363 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.789542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.791857 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.792317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.793099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:21.793539 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:21.940171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:21.949745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7b3ec50a-5356-4f94-884d-b25b20958b5c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1681 microversion: 2.1 time: 0.171776 Apr 05 13:47:21.950018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:21.950562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 311/589] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:21 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:21.957915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-14af440b-e2e4-4f9f-bb85-83a43e2444d0 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.188467 Apr 05 13:47:21.958635 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 279/590] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:21 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:22.968143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:22.968756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:22.974561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:22.975153 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:22.975397 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:22.975640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:22.976703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:22.977137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:22.982584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:22.983036 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:22.983829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:22.984269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:23.121300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:23.128654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-97aeb447-9379-4dfb-92b9-e2dc90debebc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1681 microversion: 2.1 time: 0.164397 Apr 05 13:47:23.129230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 312/591] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:22 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:23.137460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:23.145299 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3dcfaab3-a05e-4194-a0ff-d65b6f266c90 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.174582 Apr 05 13:47:23.145942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 280/592] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:22 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:24.145764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:24.146478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:24.152548 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:24.152994 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:24.153766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:24.154208 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:24.164736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:24.165498 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:24.171573 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:24.172113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:24.172963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:24.173625 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:24.249223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:24.257321 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8726e6be-50e1-4034-adea-88ba60aaa509 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 200 len: 1614 microversion: 2.1 time: 0.115696 Apr 05 13:47:24.268227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 313/593] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:24 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:24.325413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:24.333572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a685b73-179f-4b33-9ee6-ae3156c57ea9 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.173260 Apr 05 13:47:24.334150 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 281/594] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:24 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:24.545206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-9efe6c96-3716-4b0f-b10b-89346d059294 req-83d9b13b-f536-43cc-8c08-73f60d6d1eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcf398b-babb-4847-a7f6-19219fca641e", "name": "network-vif-deleted", "tag": "e655642e-a80e-43df-bfde-59c9592afe81"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:24.554410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-9efe6c96-3716-4b0f-b10b-89346d059294 req-83d9b13b-f536-43cc-8c08-73f60d6d1eaf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:24.554891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-9efe6c96-3716-4b0f-b10b-89346d059294 req-83d9b13b-f536-43cc-8c08-73f60d6d1eaf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:24.572588 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-9efe6c96-3716-4b0f-b10b-89346d059294 req-83d9b13b-f536-43cc-8c08-73f60d6d1eaf service nova] Creating event network-vif-deleted:e655642e-a80e-43df-bfde-59c9592afe81 for instance 3dcf398b-babb-4847-a7f6-19219fca641e on hv-cinder-83587 Apr 05 13:47:24.597473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-9efe6c96-3716-4b0f-b10b-89346d059294 req-83d9b13b-f536-43cc-8c08-73f60d6d1eaf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059049 Apr 05 13:47:24.598396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 314/595] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:25.276830 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:25.277641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:25.283959 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:25.284417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:25.285445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:25.285890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:25.301516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. Apr 05 13:47:25.302117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:47:25.302962 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b30f900f-f1d9-4c70-944a-60eba4fbff79 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 404 len: 111 microversion: 2.1 time: 0.031209 Apr 05 13:47:25.303548 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 282/596] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:25 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:47:25.313422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-12ab3ccf-b904-437e-9e50-5da7a9fc84f4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '.version_select at 0x7f9bfd814af0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:25.332581 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-12ab3ccf-b904-437e-9e50-5da7a9fc84f4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068836186" status: 202 len: 0 microversion: 2.1 time: 0.023968 Apr 05 13:47:25.333174 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 315/597] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Apr 5 13:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068836186 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:47:25.352091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:25.352833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:25.359091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:25.359589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:25.360390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:25.360835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:25.596702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:25.607051 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-30e5f961-61c0-4be7-b83f-d36615067b17 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.260407 Apr 05 13:47:25.611538 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 283/598] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:25 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:26.292353 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: .version_select at 0x7f9bfd7dd790>, body: {"keypair": {"name": "tempest-keypair-1900291012"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:26.306723 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:26.311074 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:26.473828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:26.477757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:26.489992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-84a75bbb-0f3a-4f14-a0ff-5780aa790f85 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.201525 Apr 05 13:47:26.490592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 316/599] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:47:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:26.624185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:26.625331 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:26.637244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:26.637702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:26.638516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:26.638948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:26.854385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:26.862337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d892efeb-3c94-4b3f-baa4-89c291809516 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.241959 Apr 05 13:47:26.862904 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 284/600] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:26 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:27.825434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1066428325", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3cff852-d241-43ab-830a-cae40270149a"}], "security_groups": [{"name": "tempest-securitygroup--1028685547"}], "key_name": "tempest-keypair-1900291012", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:27.879555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:27.880137 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:27.887169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:27.887673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:27.888481 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:27.888924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:27.925887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] validate_networks() for [('c3cff852-d241-43ab-830a-cae40270149a', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:47:28.035988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:28.044554 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b42e234d-c6e4-4980-8e4f-9cd2420cd0a7 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.168799 Apr 05 13:47:28.045164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 285/601] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:27 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:28.293728 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:47:28.294155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:47:28.294645 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:47:28.295045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:47:28.295461 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:47:28.305704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:28.306212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:28.307227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:28.307774 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:28.324517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:28.328394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:28.338952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:47:28.341352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:47:28.388558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b528195e-c025-4ad0-be79-8c183314e889 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568403 Apr 05 13:47:28.389579 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 317/602] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:47:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:47:28.399138 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ea6d139e-ff92-47ac-b156-725f7d85525a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:28.399770 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ea6d139e-ff92-47ac-b156-725f7d85525a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:28.450634 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ea6d139e-ff92-47ac-b156-725f7d85525a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:28.457198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ea6d139e-ff92-47ac-b156-725f7d85525a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1242 microversion: 2.1 time: 0.061969 Apr 05 13:47:28.457751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 286/603] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:28 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1242 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:29.062458 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:29.062998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:29.069620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:29.070074 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:29.070941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:29.071387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:29.231948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:29.239873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7b3198b3-9ccd-4836-8cf7-d56316f41fe8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.182131 Apr 05 13:47:29.240450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 318/604] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:29 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:29.473015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:29.474198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:29.481148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:29.481860 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:29.482913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:29.483362 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:29.547337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:29.555389 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4604002e-8234-4b81-9478-a83d93b9a95b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1300 microversion: 2.1 time: 0.085695 Apr 05 13:47:29.556089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 287/605] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:29 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:30.259632 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:30.260259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:30.266329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:30.266724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:30.267489 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:30.269843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:30.503946 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:30.516428 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-61065924-ff71-42fb-9121-ae17fac1eaf1 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.260529 Apr 05 13:47:30.517424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 319/606] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:30 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:30.574394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:30.575139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:30.582671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:30.583216 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:30.584125 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:30.584624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:30.726506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:30.735058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7b5a772f-2865-4c2d-a04f-b0bef9d1dc93 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.165480 Apr 05 13:47:30.735980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 288/607] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:30 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:30.783005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-1250cdcd-01af-493d-9ad1-fe1d7e03ae41 req-5775f7e7-542b-4f28-9dcf-8b125a21295f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1973be0b-72c3-40eb-8bf6-3ebb28381096", "tag": "0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:30.793026 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1250cdcd-01af-493d-9ad1-fe1d7e03ae41 req-5775f7e7-542b-4f28-9dcf-8b125a21295f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:30.793473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1250cdcd-01af-493d-9ad1-fe1d7e03ae41 req-5775f7e7-542b-4f28-9dcf-8b125a21295f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:30.809766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-1250cdcd-01af-493d-9ad1-fe1d7e03ae41 req-5775f7e7-542b-4f28-9dcf-8b125a21295f service nova] Creating event network-changed:0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed for instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 on hv-cinder-83587 Apr 05 13:47:30.814378 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-1250cdcd-01af-493d-9ad1-fe1d7e03ae41 req-5775f7e7-542b-4f28-9dcf-8b125a21295f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 Apr 05 13:47:30.814984 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 320/608] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:31.535240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:31.536099 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:31.542508 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:31.542958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:31.543946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:31.544461 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:31.688447 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:31.696364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2e78e816-81a9-438f-8a49-2705af5ee13d tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.165314 Apr 05 13:47:31.696922 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 289/609] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:31 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:31.752815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:31.753505 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:31.759774 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:31.760223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:31.761268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:31.761749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:31.901543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:31.908966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c82c2d31-b88b-48df-a834-1eefec1a4f97 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.160739 Apr 05 13:47:31.909535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 321/610] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:31 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:32.617664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:32.618391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:32.624570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.625015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.625781 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.626213 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.656279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3c54ece8-94e3-41cd-a9ab-e8f36d964008 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments/2bf3f551-51ba-4eb2-b86f-a6daae296930" status: 200 len: 194 microversion: 2.20 time: 0.043141 Apr 05 13:47:32.656866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 290/611] 10.222.0.59 () {60 vars in 1453 bytes} [Tue Apr 5 13:47:32 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments/2bf3f551-51ba-4eb2-b86f-a6daae296930 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:47:32.713576 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:32.714503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:32.718600 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:32.719093 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:32.720546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.720876 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.721653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.722099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.724886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.725330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.727165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.727165 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.860017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lazy-loading 'services' on Instance uuid e37a50af-47fc-4de4-a209-8116bed7038d {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:47:32.900202 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:32.907825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5e448edf-3ccc-428e-be4a-29fcdb96f483 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.198294 Apr 05 13:47:32.908397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 322/612] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:32 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:32.925878 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:32.926495 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:32.932697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.933150 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.933924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:32.934369 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:32.984056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5ae4b9fc-4117-40fd-9d74-4d078328dc3b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments/2bf3f551-51ba-4eb2-b86f-a6daae296930" status: 202 len: 0 microversion: 2.20 time: 0.268936 Apr 05 13:47:32.985130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 291/613] 10.222.0.59 () {60 vars in 1456 bytes} [Tue Apr 5 13:47:32 2022] DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments/2bf3f551-51ba-4eb2-b86f-a6daae296930 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 13:47:32.994907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:32.995754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:33.001845 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:33.002295 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:33.003071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:33.003561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:33.034813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-349f2047-cb0a-4bec-b045-ab46d3abbb13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045381 Apr 05 13:47:33.035446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 292/614] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Apr 5 13:47:32 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:47:33.091907 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:33.099432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a367ca2-399e-4435-9819-8079f3728b8f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.177361 Apr 05 13:47:33.100047 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 323/615] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:32 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:33.925917 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:33.926962 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:33.934407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:33.934858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:33.935650 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:33.936095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.046390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:34.047464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:34.053729 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:34.054183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.055949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:34.056395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.085416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a0bc1e55-671c-47ac-a986-4313da11eba6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043067 Apr 05 13:47:34.085734 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:34.086291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 324/616] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Apr 5 13:47:34 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:47:34.093888 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-40ef8b4d-334b-45f5-9190-73e313217d33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1756 microversion: 2.1 time: 0.173051 Apr 05 13:47:34.094478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 293/617] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:33 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:34.116583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:34.118037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:34.123779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:34.124223 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.124975 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:34.125404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.256853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:34.264578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3c3ae9d8-418b-430e-aacf-90d13c81bb67 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.151673 Apr 05 13:47:34.265143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 325/618] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:34 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:34.951418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-eb85e7fd-6f3f-4163-bc6a-a1791a1b47fc req-53f25473-e2c2-454c-be94-29f3477edbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973be0b-72c3-40eb-8bf6-3ebb28381096", "name": "network-vif-plugged", "status": "completed", "tag": "0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:34.960223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-eb85e7fd-6f3f-4163-bc6a-a1791a1b47fc req-53f25473-e2c2-454c-be94-29f3477edbe8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:34.961884 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-eb85e7fd-6f3f-4163-bc6a-a1791a1b47fc req-53f25473-e2c2-454c-be94-29f3477edbe8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:34.973444 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-eb85e7fd-6f3f-4163-bc6a-a1791a1b47fc req-53f25473-e2c2-454c-be94-29f3477edbe8 service nova] Creating event network-vif-plugged:0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed for instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 on hv-cinder-83587 Apr 05 13:47:34.979278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-eb85e7fd-6f3f-4163-bc6a-a1791a1b47fc req-53f25473-e2c2-454c-be94-29f3477edbe8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Apr 05 13:47:34.980247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 294/619] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:35.097583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:35.098423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:35.105765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.106215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.107271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.107735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.112443 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:35.113291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:35.119486 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.119967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.120783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.121213 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.136308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4a800d49-00a3-443c-abd6-cfebf2cfae1e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042705 Apr 05 13:47:35.136893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 326/620] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Apr 5 13:47:35 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:35.199086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:35.199603 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:35.205440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.206081 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.206850 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.207278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.232433 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:47:35.274182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:35.282903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-51900b36-104c-4506-9654-617d50fb3a22 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1759 microversion: 2.1 time: 0.175035 Apr 05 13:47:35.283479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 295/621] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:35 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:47:35.288377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:35.289385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:35.295266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.295753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.296581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.297018 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.311722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-40bbd522-5bdf-4cc8-8ef0-14aa06256935 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 204 len: 0 microversion: 2.20 time: 0.116317 Apr 05 13:47:35.312682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 327/622] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Apr 5 13:47:35 2022] DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 05 13:47:35.322157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:35.322877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:35.332268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.332712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.333480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:35.333906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:35.445665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:35.452947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b40efe13-21b2-471f-aaf7-f5c506718ebe tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.168490 Apr 05 13:47:35.453745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 296/623] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:35 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:35.473637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:35.482638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:35.484180 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:35.485430 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f21df15c-4fa2-48bf-b15f-17f929349129 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.168276 Apr 05 13:47:35.486624 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 328/624] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:35 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:47:36.470062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:36.470647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:36.477998 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:36.478454 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:36.479240 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:36.479704 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:36.506550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:36.507189 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:36.513644 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:36.514098 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:36.514871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:36.515318 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:36.615330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:36.623392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-83324b3a-747f-4f1f-9f4d-baae7d3021de tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.157108 Apr 05 13:47:36.624009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 297/625] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:36 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:36.654115 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:36.662179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:36.664278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:36.665445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7948d4e3-8717-4673-b59f-208e98808f4a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.162738 Apr 05 13:47:36.666016 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 329/626] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:36 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:47:37.639370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:37.640105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:37.646383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:37.646835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:37.647640 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:37.648296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:37.684760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:37.685403 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:37.692001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:37.692455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:37.693235 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:37.693705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:37.794884 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:37.802109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-508532ed-1d0d-4a55-9120-466e5347f548 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1368 microversion: 2.1 time: 0.166543 Apr 05 13:47:37.802663 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 298/627] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:37 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:37.946507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:37.954260 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:37.955771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:37.957146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-13a831a4-1525-4659-a062-2625bd856d20 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1724 microversion: 2.20 time: 0.276412 Apr 05 13:47:37.957799 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 330/628] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:37 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:38.820633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:38.821929 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:38.828564 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:38.829015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:38.829805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:38.830226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:38.846619 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-a5588f22-7adc-4c22-aa8c-0cfa9a808241 req-a209b40b-92f2-403c-8706-b4c2ba4e29d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37a50af-47fc-4de4-a209-8116bed7038d", "name": "network-vif-deleted", "tag": "18abb312-259e-4ad9-aee4-8094c991ad8e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:38.860508 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a5588f22-7adc-4c22-aa8c-0cfa9a808241 req-a209b40b-92f2-403c-8706-b4c2ba4e29d4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:38.860954 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a5588f22-7adc-4c22-aa8c-0cfa9a808241 req-a209b40b-92f2-403c-8706-b4c2ba4e29d4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:38.877769 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-a5588f22-7adc-4c22-aa8c-0cfa9a808241 req-a209b40b-92f2-403c-8706-b4c2ba4e29d4 service nova] Creating event network-vif-deleted:18abb312-259e-4ad9-aee4-8094c991ad8e for instance e37a50af-47fc-4de4-a209-8116bed7038d on hv-cinder-83587 Apr 05 13:47:38.886215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-a5588f22-7adc-4c22-aa8c-0cfa9a808241 req-a209b40b-92f2-403c-8706-b4c2ba4e29d4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044701 Apr 05 13:47:38.890272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 331/629] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:47:38.978814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:38.983287 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:38.984243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:38.986751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3ccf39ba-e828-4b6d-b391-917e17ee24d4 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1558 microversion: 2.1 time: 0.170686 Apr 05 13:47:38.987339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 299/630] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:38 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:38.992611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:38.993179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:38.994022 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:38.994461 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:39.004320 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:39.004816 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:39.014751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:39.015213 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:39.016043 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:39.016507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:39.040460 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:39.040902 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:39.041352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lazy-loading 'fault' on Instance uuid e37a50af-47fc-4de4-a209-8116bed7038d {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:47:39.088949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:39.097255 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:39.098945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:39.102691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cc3f2f2a-9587-42b9-8a8f-a34ceb5584ca tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102249 Apr 05 13:47:39.103398 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8a4afa8f-1e8d-4be3-bf02-6246d2fe1d89 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 200 len: 1372 microversion: 2.20 time: 0.129555 Apr 05 13:47:39.104090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 332/631] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:38 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:39.109483 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 300/632] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:47:38 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:47:40.129962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:40.129962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:40.129962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:40.129962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:40.130695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:40.130822 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:40.144879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. Apr 05 13:47:40.145478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:47:40.146347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0c7a4eb3-97c2-42fa-82ee-d1ce4f91f395 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 404 len: 111 microversion: 2.20 time: 0.028437 Apr 05 13:47:40.146894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 333/633] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:40 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:47:40.156387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8348c29e-e599-42fc-b565-68588a2daebe tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '.version_select at 0x7f9bfd8fe820>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:40.178232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8348c29e-e599-42fc-b565-68588a2daebe tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240488737" status: 204 len: 0 microversion: 2.20 time: 0.026089 Apr 05 13:47:40.178814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 301/634] 10.222.0.59 () {60 vars in 1261 bytes} [Tue Apr 5 13:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240488737 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 13:47:40.237292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9bfa8cb-83ef-4392-b1f2-9da265e1ab7c"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:40.239060 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:40.245153 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:40.245623 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:40.246519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:40.247322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:40.523455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c4778bed-f068-41a6-8d7c-6efaeda72644 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289351 Apr 05 13:47:40.524861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 334/635] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:47:40 2022] POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:40.870911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: .version_select at 0x7f9bfd9341f0>, body: {"keypair": {"name": "tempest-keypair-388907273"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:40.885915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:40.890209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:40.901484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-ce8cb81a-fcf6-4f2b-80ff-4819972b5a56 req-ac17e49b-ccb6-4622-bf80-5ac93117c55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1973be0b-72c3-40eb-8bf6-3ebb28381096", "tag": "0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:40.911292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ce8cb81a-fcf6-4f2b-80ff-4819972b5a56 req-ac17e49b-ccb6-4622-bf80-5ac93117c55c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:40.911900 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-ce8cb81a-fcf6-4f2b-80ff-4819972b5a56 req-ac17e49b-ccb6-4622-bf80-5ac93117c55c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:40.924982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-ce8cb81a-fcf6-4f2b-80ff-4819972b5a56 req-ac17e49b-ccb6-4622-bf80-5ac93117c55c service nova] Creating event network-changed:0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed for instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 on hv-cinder-83587 Apr 05 13:47:40.931377 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-ce8cb81a-fcf6-4f2b-80ff-4819972b5a56 req-ac17e49b-ccb6-4622-bf80-5ac93117c55c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034310 Apr 05 13:47:40.932107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 335/636] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:47:41.014708 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:41.018675 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:41.035357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f97374aa-7d4a-4bec-b3b4-2a6c408aa722 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.168890 Apr 05 13:47:41.036226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 302/637] 10.222.0.59 () {62 vars in 1198 bytes} [Tue Apr 5 13:47:40 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 13:47:42.664198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1276093072", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36092869-544a-41e5-a4a1-8d365ffa3fa5"}], "security_groups": [{"name": "tempest-securitygroup--1128963144"}], "key_name": "tempest-keypair-388907273", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:42.764976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] validate_networks() for [('36092869-544a-41e5-a4a1-8d365ffa3fa5', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:47:43.137678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:47:43.138097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:47:43.138561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:47:43.138966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:47:43.139368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:47:43.147953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:43.148446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:43.149112 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:43.149542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:43.165024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:47:43.168775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Getting quotas for user 1ebc660250144556aedb16590cdcce0d and project ee6e9d5de52b4741bb5efe2a286e8e52. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:47:43.179853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:47:43.182340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:47:43.228329 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fd8afcb2-2e5e-48c6-88c1-ec55b74fc3bb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.569878 Apr 05 13:47:43.228993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 336/638] 10.222.0.59 () {62 vars in 1187 bytes} [Tue Apr 5 13:47:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 13:47:43.238935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:43.239567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:43.292872 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:43.299704 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:43.301185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:43.302274 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4be8fec5-3f25-4c48-8fcc-6158962293a4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1281 microversion: 2.20 time: 0.067230 Apr 05 13:47:43.302875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 303/639] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:43 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:44.323222 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:44.323864 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:44.330481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:44.330924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:44.331713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:44.332145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:44.400162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:44.407990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:44.409473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:44.410601 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1fa1a7be-63be-440d-9db5-51cc41a4ac96 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1339 microversion: 2.20 time: 0.092409 Apr 05 13:47:44.411162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 337/640] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:44 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:45.429831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:45.431126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:45.441636 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:45.442621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:45.443473 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:45.443936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:45.583837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-a81809f8-ef08-4411-9a87-14dc6e729718 req-054ea0b8-8e4b-4a2c-9673-5e0bb192ebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:45.597242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a81809f8-ef08-4411-9a87-14dc6e729718 req-054ea0b8-8e4b-4a2c-9673-5e0bb192ebe4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:45.597594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a81809f8-ef08-4411-9a87-14dc6e729718 req-054ea0b8-8e4b-4a2c-9673-5e0bb192ebe4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:45.599520 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:45.609146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:45.610777 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:45.612338 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-85a20828-d9bc-486d-aa89-3bb752c9f1cb tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.186888 Apr 05 13:47:45.616212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 304/641] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:45 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:45.618867 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-a81809f8-ef08-4411-9a87-14dc6e729718 req-054ea0b8-8e4b-4a2c-9673-5e0bb192ebe4 service nova] Creating event network-changed:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:47:45.624747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-a81809f8-ef08-4411-9a87-14dc6e729718 req-054ea0b8-8e4b-4a2c-9673-5e0bb192ebe4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045995 Apr 05 13:47:45.625359 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 338/642] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:46.630250 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:46.630868 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:46.637706 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:46.638154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:46.638912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:46.639343 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:46.766745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:46.775270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:46.776778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:46.777865 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-17c55094-373b-4bd2-9ca8-8dd4013f9a6e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.151596 Apr 05 13:47:46.778574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 305/643] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:46 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:47.796647 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:47.797338 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:47.803432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:47.805016 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:47.805757 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:47.806197 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:48.021453 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:48.030065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:48.031872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:48.033220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ac38dcb7-a92c-4ab6-bd6b-d89b09ced63e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.241251 Apr 05 13:47:48.033999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 339/644] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:47 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:49.051650 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:49.052912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:49.060140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.060589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.061361 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.062187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.067464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:49.069143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:49.076161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.076679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.077502 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.077976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.104427 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lazy-loading 'flavor' on Instance uuid 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:47:49.206519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:49.214896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:49.216407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:49.217504 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cdfd01b5-3424-4fd7-9d2f-a7c22ff8986a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.169768 Apr 05 13:47:49.218056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 306/645] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:49 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:49.230089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9531cebb-88b5-4dfa-a7d4-88f861b926aa tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/action" status: 200 len: 32 microversion: 2.1 time: 0.166697 Apr 05 13:47:49.230700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 340/646] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:47:49 2022] POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 13:47:49.239378 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:49.240054 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:49.246117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.246571 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.247468 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:49.247936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:49.390303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:49.398878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c12309b5-91a8-481c-a918-d88321a4cbe2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.163153 Apr 05 13:47:49.400061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 307/647] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:49 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:50.237411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:50.238108 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:50.244796 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:50.245247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:50.246014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:50.246454 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:50.378559 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:50.386346 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:50.387875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:50.388989 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c788a4c0-5be1-4b63-ae90-f6971c98aa65 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.156319 Apr 05 13:47:50.389550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 341/648] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:50 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:50.416556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:50.417170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:50.423817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:50.424270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:50.425047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:50.425485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:50.562797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:50.570546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f39362ee-2a81-4384-97cf-b4bae823d842 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.158822 Apr 05 13:47:50.571111 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 308/649] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:50 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:51.066081 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-eccb56d7-018e-4247-a373-74fd5e233f4e req-4d5dad2f-4528-4e40-9c38-afab6e7cce28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "name": "network-vif-plugged", "status": "completed", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:51.075211 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-eccb56d7-018e-4247-a373-74fd5e233f4e req-4d5dad2f-4528-4e40-9c38-afab6e7cce28 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:51.075688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-eccb56d7-018e-4247-a373-74fd5e233f4e req-4d5dad2f-4528-4e40-9c38-afab6e7cce28 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:51.087352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-eccb56d7-018e-4247-a373-74fd5e233f4e req-4d5dad2f-4528-4e40-9c38-afab6e7cce28 service nova] Creating event network-vif-plugged:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:47:51.092061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-eccb56d7-018e-4247-a373-74fd5e233f4e req-4d5dad2f-4528-4e40-9c38-afab6e7cce28 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029775 Apr 05 13:47:51.092659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 342/650] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:51.406955 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:51.407487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:51.413497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:51.414168 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:51.414939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:51.415380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:51.561327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:51.568900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:51.571249 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:51.572365 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1e6e2118-aaf8-4f37-bc4c-309d6f3038a9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.169337 Apr 05 13:47:51.572925 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 309/651] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:51 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:51.589006 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:51.589691 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:51.595726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:51.596175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:51.596921 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:51.597351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:51.730717 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:51.738467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a007c3f8-8f77-494d-bcc6-dfd92d8985f6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.154419 Apr 05 13:47:51.739034 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 343/652] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:51 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:52.590725 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:52.591356 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:52.597603 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:52.598057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:52.598831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:52.599272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:52.729516 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:52.737177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:52.738661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:52.739777 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e2297b9c-ce92-4eff-ae50-b180aff75058 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1407 microversion: 2.20 time: 0.152919 Apr 05 13:47:52.740332 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 310/653] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:52 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:52.756005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:52.756642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:52.763267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:52.763747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:52.764509 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:52.764942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:52.901217 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:52.908953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e43b8e0d-c381-4a16-b51d-8594a7948e3c tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.156781 Apr 05 13:47:52.909523 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 344/654] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:52 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:53.759277 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:53.759935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:53.765814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.766259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:53.767017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.767445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:53.901530 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:53.909154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:53.910651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:53.911814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6e59f6d4-1954-4755-ab7c-15511937b35e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1599 microversion: 2.20 time: 0.157176 Apr 05 13:47:53.912377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 311/655] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:47:53 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:47:53.925905 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:53.926603 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:53.929651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:53.930141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:53.933583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.934039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:53.934809 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.935247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:53.935710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.936156 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:53.936913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:53.937340 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:54.019274 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bedc10e2-fdb2-4dec-9a43-8b67ec1d14a0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093834 Apr 05 13:47:54.019968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 312/656] 10.222.0.59 () {60 vars in 1315 bytes} [Tue Apr 5 13:47:53 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:47:54.067000 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:54.075950 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f3020ccb-573e-48db-849d-90ce76af8e6e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.153714 Apr 05 13:47:54.076566 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 345/657] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:53 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:54.972968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2259bc13-159e-4472-aa09-90ecf9dd4c15 req-7d58e8ba-2f70-4b7e-9395-0a37681a1cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:47:54.983559 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2259bc13-159e-4472-aa09-90ecf9dd4c15 req-7d58e8ba-2f70-4b7e-9395-0a37681a1cee service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:54.984236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2259bc13-159e-4472-aa09-90ecf9dd4c15 req-7d58e8ba-2f70-4b7e-9395-0a37681a1cee service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:54.995221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2259bc13-159e-4472-aa09-90ecf9dd4c15 req-7d58e8ba-2f70-4b7e-9395-0a37681a1cee service nova] Creating event network-changed:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:47:55.000498 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2259bc13-159e-4472-aa09-90ecf9dd4c15 req-7d58e8ba-2f70-4b7e-9395-0a37681a1cee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031232 Apr 05 13:47:55.001123 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 313/658] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:47:55.093955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:55.094827 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:55.101774 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:55.102385 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:55.103264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:55.103848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:55.331916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:55.340380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8aa4ca24-a590-45d1-b0d5-f81748200313 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.250275 Apr 05 13:47:55.341173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 346/659] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:55 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:56.358205 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:56.358916 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:56.364971 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:56.365419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:56.366754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:56.367186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:56.497905 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:56.505507 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-17f47fa5-fdf1-44b7-b024-81efa1da24d3 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.151933 Apr 05 13:47:56.506068 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 314/660] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:56 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:57.522934 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:57.523562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:57.529995 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:57.530440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:57.531196 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:57.531661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:57.668263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:57.675983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2965b47f-3e71-4240-974f-10a9ef7603b4 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.157351 Apr 05 13:47:57.676554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 347/661] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:57 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:58.692724 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:58.693263 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:58.699535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:58.699985 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:58.700746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:58.701176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:58.835658 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:47:58.843607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-72cd04f2-e135-43f5-8c24-16c3529f00b9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.154788 Apr 05 13:47:58.844178 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 315/662] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:58 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:47:59.861748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:47:59.862347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:47:59.868825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:59.869268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:47:59.870019 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:47:59.870446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:00.005647 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:00.015422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-536003f2-3aed-4124-b0a9-02819feeb391 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.157531 Apr 05 13:48:00.016017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 348/663] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:47:59 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:01.033598 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:01.034203 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:01.040530 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:01.040983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:01.041747 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:01.042187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:01.172800 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:01.183270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a783370-574a-4efc-bc9b-6a2ca9f264f1 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.153524 Apr 05 13:48:01.184242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 316/664] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:01 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:48:02.201091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:02.201626 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:02.208099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:02.208653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:02.210886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:02.211077 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:02.341038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:02.348755 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9d3eb102-813b-4681-985f-53605e0b9f7f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1735 microversion: 2.1 time: 0.151623 Apr 05 13:48:02.349325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 349/665] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:02 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:03.366556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:03.367158 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:03.373417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.373864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.374649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.375082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.516440 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:03.524290 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6f3227c7-c732-46bf-a4a1-c90c14078290 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1715 microversion: 2.1 time: 0.162020 Apr 05 13:48:03.524866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 317/666] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:03 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:03.627549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:03.628042 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:03.636549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.637351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.638722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.639171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.725040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] HTTP exception thrown: Cannot 'detach_volume' instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 while it is in vm_state rescued Apr 05 13:48:03.726380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Returning 409 to user: Cannot 'detach_volume' instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 while it is in vm_state rescued {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:03.727202 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6e3c1813-1256-42ea-9bed-0d0ad27dc473 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments/a9bfa8cb-83ef-4392-b1f2-9da265e1ab7c" status: 409 len: 152 microversion: 2.1 time: 0.103785 Apr 05 13:48:03.727775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 350/667] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:48:03 2022] DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments/a9bfa8cb-83ef-4392-b1f2-9da265e1ab7c => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 13:48:03.747741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:03.748271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:03.754422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.754865 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.755654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.756087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.818218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e79fde6c-ab59-451f-a451-17fbc54b4865 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/action" status: 202 len: 0 microversion: 2.1 time: 0.085740 Apr 05 13:48:03.818903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 318/668] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:48:03 2022] POST /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:03.827191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:03.827828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:03.833613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.834094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:03.835010 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:03.835660 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:04.060818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:04.068855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d716b53b-4bad-415f-a784-e050a64ded7b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1723 microversion: 2.1 time: 0.245468 Apr 05 13:48:04.069428 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 351/669] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:03 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:05.088030 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:05.089144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:05.098042 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:05.098435 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:05.099211 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:05.099713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:05.234928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:05.247578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a74ebf09-da1c-4657-97d3-3f69cb6f8cc2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1723 microversion: 2.1 time: 0.165019 Apr 05 13:48:05.248148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 319/670] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:05 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:06.265296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:06.265898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:06.272129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:06.272573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:06.273322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:06.273753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:06.415449 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:06.424219 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f5d6385f-2ddb-4991-8da6-3a7e0d5d6897 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1723 microversion: 2.1 time: 0.162766 Apr 05 13:48:06.425242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 352/671] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:06 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:07.441461 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:07.442077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:07.449393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:07.449842 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:07.450613 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:07.451049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:07.581862 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:07.590253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ada0ef77-1339-4d7a-948d-d02e34a10315 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1729 microversion: 2.1 time: 0.152778 Apr 05 13:48:07.590814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 320/672] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:07 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:07.606942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:07.607440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:07.613652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:07.614097 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:07.614855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:07.615287 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:07.699895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fcbe2fc7-5ea6-426c-a867-04490c784684 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096710 Apr 05 13:48:07.700505 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 353/673] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:48:07 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:08.884270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-bfd7920f-7f02-4528-8c1f-f2be8991d023 req-71a6d93f-9c39-4d88-9e72-bbe3a7260d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:08.902488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bfd7920f-7f02-4528-8c1f-f2be8991d023 req-71a6d93f-9c39-4d88-9e72-bbe3a7260d2a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:08.903043 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bfd7920f-7f02-4528-8c1f-f2be8991d023 req-71a6d93f-9c39-4d88-9e72-bbe3a7260d2a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:08.915404 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-bfd7920f-7f02-4528-8c1f-f2be8991d023 req-71a6d93f-9c39-4d88-9e72-bbe3a7260d2a service nova] Creating event network-changed:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:48:08.920471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-bfd7920f-7f02-4528-8c1f-f2be8991d023 req-71a6d93f-9c39-4d88-9e72-bbe3a7260d2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040901 Apr 05 13:48:08.921356 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 321/674] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:10.936046 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-5b79ca98-17b5-4bec-8802-fcf95fa35e46 req-ecd296c3-1dbd-4acd-b686-97250dcbaed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:10.944747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-5b79ca98-17b5-4bec-8802-fcf95fa35e46 req-ecd296c3-1dbd-4acd-b686-97250dcbaed9 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:10.944932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-5b79ca98-17b5-4bec-8802-fcf95fa35e46 req-ecd296c3-1dbd-4acd-b686-97250dcbaed9 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:10.956846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-5b79ca98-17b5-4bec-8802-fcf95fa35e46 req-ecd296c3-1dbd-4acd-b686-97250dcbaed9 service nova] Creating event network-changed:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:48:10.961825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-5b79ca98-17b5-4bec-8802-fcf95fa35e46 req-ecd296c3-1dbd-4acd-b686-97250dcbaed9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029931 Apr 05 13:48:10.962404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 354/675] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:16.998429 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-994863350"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:16.999087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:17.005221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:17.005682 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:17.007378 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:17.007862 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:17.290005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.network.security_group_api [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Removing security group fa4bd02d-8e2d-4bf4-95f5-98fa20f0115a from port b68cef7c-d9bf-494a-be42-2c1584ca80e8 Apr 05 13:48:17.637355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-779063e2-ec22-470b-af61-524849175991 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action" status: 202 len: 0 microversion: 2.1 time: 0.643025 Apr 05 13:48:17.638257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 322/676] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:48:16 2022] POST /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:17.647459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-e36d43e9-d6d9-44ad-84b9-965639093d14 req-5eafb923-ef9e-4f14-9859-8cacc7ac63ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:17.658257 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e36d43e9-d6d9-44ad-84b9-965639093d14 req-5eafb923-ef9e-4f14-9859-8cacc7ac63ac service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:17.659116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e36d43e9-d6d9-44ad-84b9-965639093d14 req-5eafb923-ef9e-4f14-9859-8cacc7ac63ac service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:17.675486 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-e36d43e9-d6d9-44ad-84b9-965639093d14 req-5eafb923-ef9e-4f14-9859-8cacc7ac63ac service nova] Creating event network-changed:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:48:17.680966 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-e36d43e9-d6d9-44ad-84b9-965639093d14 req-5eafb923-ef9e-4f14-9859-8cacc7ac63ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038133 Apr 05 13:48:17.681928 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 355/677] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:18.935229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:18.935819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:18.941996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:18.942448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:18.943207 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:18.944211 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:19.026066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lazy-loading 'services' on Instance uuid d7c72698-f879-4ec1-84cc-63e1033dc930 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:19.096973 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5f007ca5-012a-47ee-967d-713ae8a905f8 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments/45318de3-cbf4-4801-afb7-9cc606ba09eb" status: 202 len: 0 microversion: 2.1 time: 0.166044 Apr 05 13:48:19.097581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 323/678] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:48:18 2022] DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments/45318de3-cbf4-4801-afb7-9cc606ba09eb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:19.113220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:19.114229 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:19.122559 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:19.122957 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:19.123952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:19.124432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:19.158341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8272da5f-13a7-4c72-9a52-a9259af27206 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055135 Apr 05 13:48:19.162221 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 356/679] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:19 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:19.697612 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-66d43401-6a93-4847-8e51-320d98cf96af req-9443d7dd-b5f7-4dda-8f76-b8626a31df74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:19.705662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-66d43401-6a93-4847-8e51-320d98cf96af req-9443d7dd-b5f7-4dda-8f76-b8626a31df74 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:19.706104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-66d43401-6a93-4847-8e51-320d98cf96af req-9443d7dd-b5f7-4dda-8f76-b8626a31df74 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:19.717312 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-66d43401-6a93-4847-8e51-320d98cf96af req-9443d7dd-b5f7-4dda-8f76-b8626a31df74 service nova] Creating event network-changed:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:48:19.722074 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-66d43401-6a93-4847-8e51-320d98cf96af req-9443d7dd-b5f7-4dda-8f76-b8626a31df74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028624 Apr 05 13:48:19.722675 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 324/680] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:20.170738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:20.171711 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:20.178384 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:20.178855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:20.179666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:20.180290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:20.208704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ad44a211-aab8-44c8-b38d-e3a5655d5699 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041929 Apr 05 13:48:20.209423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 357/681] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:20 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:48:20.220864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:20.221430 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:20.227856 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:20.228311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:20.229078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:20.229511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:20.305529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] HTTP exception thrown: Instance d7c72698-f879-4ec1-84cc-63e1033dc930 is not attached to volume 45318de3-cbf4-4801-afb7-9cc606ba09eb Apr 05 13:48:20.306251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Returning 404 to user: Instance d7c72698-f879-4ec1-84cc-63e1033dc930 is not attached to volume 45318de3-cbf4-4801-afb7-9cc606ba09eb {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:20.307091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a0ef325c-be71-4fb9-9751-c39b9c992a8e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments/45318de3-cbf4-4801-afb7-9cc606ba09eb" status: 404 len: 154 microversion: 2.1 time: 0.091081 Apr 05 13:48:20.307673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 325/682] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:48:20 2022] DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930/os-volume_attachments/45318de3-cbf4-4801-afb7-9cc606ba09eb => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:48:21.438837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:21.439335 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:21.447185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:21.447751 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:21.448531 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:21.448967 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:21.472273 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:48:21.545548 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-82d05ed0-8679-4f62-a29a-feea7218881b tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 204 len: 0 microversion: 2.1 time: 0.110267 Apr 05 13:48:21.546149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 358/683] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:48:21 2022] DELETE /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:48:21.555033 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:21.555696 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:21.562104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:21.562550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:21.563315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:21.563774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:21.701079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:21.708529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-58159782-5267-4d05-8c30-d76d9966dd33 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1554 microversion: 2.1 time: 0.157939 Apr 05 13:48:21.709684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 326/684] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:21 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:22.728113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:22.728803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:22.735009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:22.735452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:22.736241 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:22.736670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:22.928009 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:22.935206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e895de37-0941-44a3-94ad-3ad820d92502 tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1554 microversion: 2.1 time: 0.212120 Apr 05 13:48:22.935815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 359/685] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:22 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:23.858840 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:23.859473 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:23.865798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:23.866061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:23.866702 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:23.867143 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:23.889782 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fe66c8f2-78d4-4ae2-a374-29b7f6a12da5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/ips" status: 200 len: 149 microversion: 2.1 time: 0.034868 Apr 05 13:48:23.890355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 327/686] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:48:23 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:23.953141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:23.954353 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:23.962987 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:23.963203 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:23.964206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:23.964807 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:24.070824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72a02ac11da4c6898f1ec9fa1c310f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad212df8938b49c5b4ea37ea0e5428d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:24.071066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2c6c5d6d-0255-4940-a73a-6874fd3b4b88 req-1d363b33-4677-4852-abe8-7b9f5d2d6c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c72698-f879-4ec1-84cc-63e1033dc930", "name": "network-vif-deleted", "tag": "b68cef7c-d9bf-494a-be42-2c1584ca80e8"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:24.079286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9fe837bc-32ff-4e5d-bc34-73053c57d20a tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 200 len: 1512 microversion: 2.1 time: 0.130442 Apr 05 13:48:24.080125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 360/687] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:23 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 1512 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:24.093758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2c6c5d6d-0255-4940-a73a-6874fd3b4b88 req-1d363b33-4677-4852-abe8-7b9f5d2d6c21 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:24.094313 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2c6c5d6d-0255-4940-a73a-6874fd3b4b88 req-1d363b33-4677-4852-abe8-7b9f5d2d6c21 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:24.106144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2c6c5d6d-0255-4940-a73a-6874fd3b4b88 req-1d363b33-4677-4852-abe8-7b9f5d2d6c21 service nova] Creating event network-vif-deleted:b68cef7c-d9bf-494a-be42-2c1584ca80e8 for instance d7c72698-f879-4ec1-84cc-63e1033dc930 on hv-cinder-83587 Apr 05 13:48:24.110996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2c6c5d6d-0255-4940-a73a-6874fd3b4b88 req-1d363b33-4677-4852-abe8-7b9f5d2d6c21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044811 Apr 05 13:48:24.111595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 328/688] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:25.097616 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:25.098155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] [instance: d7c72698-f879-4ec1-84cc-63e1033dc930] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:25.106712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:25.107152 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:25.107948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:25.108400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:25.122061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] HTTP exception thrown: Instance d7c72698-f879-4ec1-84cc-63e1033dc930 could not be found. Apr 05 13:48:25.122660 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Returning 404 to user: Instance d7c72698-f879-4ec1-84cc-63e1033dc930 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:25.123482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ad659aa-c1ba-4ba9-a1f4-f507caa14ebe tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930" status: 404 len: 111 microversion: 2.1 time: 0.029901 Apr 05 13:48:25.124058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 361/689] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:25 2022] GET /compute/v2.1/servers/d7c72698-f879-4ec1-84cc-63e1033dc930 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:48:25.133601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9f42c1ff-7aed-4797-8c1e-2fd29f11b13e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] Calling method '.version_select at 0x7f9bfd7f89d0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:25.150653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9f42c1ff-7aed-4797-8c1e-2fd29f11b13e tempest-TestMinimumBasicScenario-765699414 tempest-TestMinimumBasicScenario-765699414-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709335281" status: 202 len: 0 microversion: 2.1 time: 0.021973 Apr 05 13:48:25.151214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 329/690] 10.222.0.59 () {58 vars in 1268 bytes} [Tue Apr 5 13:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709335281 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:25.274292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57673f89-2a00-447b-a3b4-b6b4abf26b18"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:25.275429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:25.283205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:25.283700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:25.284478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:25.284896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:25.559302 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cf3d162b-15f7-4c58-a00a-59a884a0106f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290921 Apr 05 13:48:25.560553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 362/691] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:48:25 2022] POST /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:33.087631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57673f89-2a00-447b-a3b4-b6b4abf26b18"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:33.088819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:33.095422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.095899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.096669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.097105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.189236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Invalid volume: volume 57673f89-2a00-447b-a3b4-b6b4abf26b18 is already attached to instances: 1973be0b-72c3-40eb-8bf6-3ebb28381096 Apr 05 13:48:33.189837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 400 to user: Invalid volume: volume 57673f89-2a00-447b-a3b4-b6b4abf26b18 is already attached to instances: 1973be0b-72c3-40eb-8bf6-3ebb28381096 {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:33.190705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-93154275-beac-41d7-99e3-5688229d4a76 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107879 Apr 05 13:48:33.191971 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 330/692] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:48:33 2022] POST /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:48:33.258205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:33.258797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:33.264745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.265200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.265983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.266420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.349599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lazy-loading 'services' on Instance uuid 1973be0b-72c3-40eb-8bf6-3ebb28381096 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:33.422936 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-21bc9f02-5fd4-4e0a-ba45-3ccab81ff23a tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments/57673f89-2a00-447b-a3b4-b6b4abf26b18" status: 202 len: 0 microversion: 2.1 time: 0.173899 Apr 05 13:48:33.423562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 363/693] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:48:33 2022] DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments/57673f89-2a00-447b-a3b4-b6b4abf26b18 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:33.432659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:33.433581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:33.441403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.441890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.442668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:33.443760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:33.474565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-188b6c07-33fa-442b-9372-7f6fe9cda471 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Apr 05 13:48:33.475785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 331/694] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:33 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:34.486801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:34.487929 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:34.494592 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.495052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.495861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.496308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.527414 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7615bbd8-0197-44c7-af86-36a7cff7b932 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044946 Apr 05 13:48:34.528137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 364/695] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:34 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:48:34.585867 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:34.586415 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:34.592648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.593105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.593900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.594376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.619835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:48:34.698817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-df9ccef9-c008-460d-977c-bb117494e940 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 204 len: 0 microversion: 2.1 time: 0.117475 Apr 05 13:48:34.699403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 332/696] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:48:34 2022] DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:48:34.708496 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:34.709857 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:34.716179 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.716903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.717694 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:34.718140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:34.922341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:34.931186 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-16d1a682-d2de-40dc-8319-e84aa4615c17 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1682 microversion: 2.1 time: 0.226705 Apr 05 13:48:34.931852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 365/697] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:34 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:36.148836 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:36.149684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:36.155671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:36.156122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:36.156892 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:36.157527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:36.467551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:36.475085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3e971d32-98e9-462b-a7a4-873cfafc14fd tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1682 microversion: 2.1 time: 0.528483 Apr 05 13:48:36.484933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 333/698] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:35 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1682 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:37.495075 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:37.498778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:37.512707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:37.513275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:37.514193 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:37.516376 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-6a628ffb-9092-4b8d-9d73-9ba7808ac0e2 req-6c7c73d9-2ba1-4d95-9042-466a5472fad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973be0b-72c3-40eb-8bf6-3ebb28381096", "name": "network-vif-deleted", "tag": "0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:37.517337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:37.535530 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6a628ffb-9092-4b8d-9d73-9ba7808ac0e2 req-6c7c73d9-2ba1-4d95-9042-466a5472fad8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:37.537699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6a628ffb-9092-4b8d-9d73-9ba7808ac0e2 req-6c7c73d9-2ba1-4d95-9042-466a5472fad8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:37.563983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-6a628ffb-9092-4b8d-9d73-9ba7808ac0e2 req-6c7c73d9-2ba1-4d95-9042-466a5472fad8 service nova] Creating event network-vif-deleted:0ecbafdd-ffd1-4ea8-ad2e-9435fc6a58ed for instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 on hv-cinder-83587 Apr 05 13:48:37.575224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-6a628ffb-9092-4b8d-9d73-9ba7808ac0e2 req-6c7c73d9-2ba1-4d95-9042-466a5472fad8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184170 Apr 05 13:48:37.578056 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 366/699] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:37.612764 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:37.613220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:37.613683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lazy-loading 'fault' on Instance uuid 1973be0b-72c3-40eb-8bf6-3ebb28381096 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:37.686633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:37.711510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d3b6cabb-5944-42d6-98a3-5d3edd9b1e4b tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 200 len: 1332 microversion: 2.1 time: 0.212861 Apr 05 13:48:37.712493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 334/700] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:37 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:38.679282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:38.680513 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:38.688530 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:38.689258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:38.690467 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:38.690917 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:38.725322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a3ad829-a586-45ca-9767-fb01d65590bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/ips" status: 200 len: 151 microversion: 2.20 time: 0.204720 Apr 05 13:48:38.726763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 367/701] 10.222.0.59 () {60 vars in 1288 bytes} [Tue Apr 5 13:48:38 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/ips => generated 151 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 13:48:38.729144 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:38.729762 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:38.740757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:38.744221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:38.745367 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:38.746065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:38.770274 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. Apr 05 13:48:38.772154 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:38.773410 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d2d515d6-cd71-4b45-a68a-46034c3e79a2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 404 len: 111 microversion: 2.1 time: 0.048817 Apr 05 13:48:38.783963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c1325dad-7841-4385-9dc2-1b35245f84ed tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '.version_select at 0x7f9bfd814280>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:38.790116 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 335/702] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:38 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:48:38.806290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c1325dad-7841-4385-9dc2-1b35245f84ed tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900291012" status: 202 len: 0 microversion: 2.1 time: 0.026889 Apr 05 13:48:38.807688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 368/703] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Apr 5 13:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900291012 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:39.948199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: .version_select at 0x7f9bfd86bb80>, body: {"keypair": {"name": "tempest-keypair-468780016"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:39.963065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:48:39.968368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:48:40.116824 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:48:40.120638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:48:40.137163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-81480d6a-e3bc-43f2-ac9b-c53c29ec7544 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.192749 Apr 05 13:48:40.138438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 336/704] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:48:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:48:40.694923 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:40.695669 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:40.701832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:40.702682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:40.703475 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:40.703955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:40.729742 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lazy-loading 'flavor' on Instance uuid fa08f903-e829-4655-b53f-46c9db758d18 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:41.053059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-58035f49-b690-4569-b51c-5be519879f73 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/action" status: 202 len: 0 microversion: 2.20 time: 0.361424 Apr 05 13:48:41.057656 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 369/705] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Apr 5 13:48:40 2022] POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:48:41.062963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:41.064505 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:41.073591 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:41.074480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:41.075667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:41.076224 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:41.506797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:41.522853 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:41.525572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:41.527137 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d09b7641-f38f-41f6-aa68-0c901ce6ec04 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.468123 Apr 05 13:48:41.528475 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 337/706] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:41 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:42.274640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236744946", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3cff852-d241-43ab-830a-cae40270149a"}], "security_groups": [{"name": "tempest-securitygroup--1198694776"}], "key_name": "tempest-keypair-468780016", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:42.497187 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] validate_networks() for [('c3cff852-d241-43ab-830a-cae40270149a', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:48:42.546414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:42.547738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:42.554688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:42.555328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:42.557555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:42.557993 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:42.724269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:42.734581 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:42.736107 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:42.737297 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-490d5b11-5c5c-40da-8025-b40970ea0060 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.194896 Apr 05 13:48:42.737855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 338/707] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:42 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:43.365299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:48:43.365838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:48:43.366352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:48:43.366826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:48:43.367305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:48:43.377268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:43.377820 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:43.378914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:43.379214 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:43.398088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:48:43.402491 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Getting quotas for user 5577d987826f4424a91c12293f2e38c7 and project 51e332af07b8443bb5fe05decbfab0b1. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:48:43.414195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:48:43.416659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:48:43.472176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7dba4b1d-ceb2-4d07-8dfe-cd16bb5afab5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.202920 Apr 05 13:48:43.473516 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 370/708] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:48:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:48:43.485079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4524f583-e47c-4a7e-9783-b19f583c3a94 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:43.491140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4524f583-e47c-4a7e-9783-b19f583c3a94 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:43.756012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:43.756636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:43.777469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:43.778072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:43.778869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:43.779308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:43.793596 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4524f583-e47c-4a7e-9783-b19f583c3a94 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:43.802728 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4524f583-e47c-4a7e-9783-b19f583c3a94 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1240 microversion: 2.1 time: 0.321437 Apr 05 13:48:43.806502 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 339/709] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:43 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1240 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:44.081517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:44.094695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:44.097147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:44.103590 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d47e530e-91de-42a4-a486-6e73a4cfc548 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.351865 Apr 05 13:48:44.104702 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 371/710] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:43 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:48:44.828443 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:44.831113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:44.856225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:44.860345 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:44.862081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:44.865086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:45.003056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:45.012663 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-27f3025e-452a-41ce-9577-f89747c025f7 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1292 microversion: 2.1 time: 0.193303 Apr 05 13:48:45.014707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 340/711] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:44 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1292 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:45.122825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:45.128542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:45.138093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:45.138910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:45.140072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:45.140660 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:45.417168 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:45.433479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:45.435007 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:45.436247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8163bb18-d248-42ca-8859-a0e7fa1e3c33 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.317995 Apr 05 13:48:45.447750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 372/712] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:45 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:46.033194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:46.033802 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:46.073308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:46.074409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:46.075360 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:46.076211 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:46.169760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Action: 'create', calling method: .version_select at 0x7f9bfd78fdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2080643478"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:46.185518 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:48:46.191115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for user 507ec53c995341ce805d43f85a4d72c3 and project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:48:46.370902 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:48:46.375051 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for user 507ec53c995341ce805d43f85a4d72c3 and project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:48:46.390969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8585ec9e-e462-4768-b38f-4b67d741e337 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.433114 Apr 05 13:48:46.391785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 341/713] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:48:45 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:46.460785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:46.461401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:46.476376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:46.476829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:46.477629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:46.480898 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:46.684381 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:46.693506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d608e29e-5711-4443-99c6-f5fb343c3703 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.664562 Apr 05 13:48:46.694096 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 373/714] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:46 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:46.703100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:46.713588 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:46.717014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:46.718498 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-63fcd8b9-70b4-4090-ace3-edc91531f72f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.268121 Apr 05 13:48:46.719688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 342/715] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:46 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:48:47.172387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:47.173083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:47.181245 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.181707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.182463 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.182903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.338094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lazy-loading 'services' on Instance uuid 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:47.455094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7321bb1c-0c27-4f41-9c10-916321430f7d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments/a9bfa8cb-83ef-4392-b1f2-9da265e1ab7c" status: 202 len: 0 microversion: 2.1 time: 0.287563 Apr 05 13:48:47.456887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 374/716] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:48:47 2022] DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments/a9bfa8cb-83ef-4392-b1f2-9da265e1ab7c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:47.479904 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:47.482062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:47.496648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.512655 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.517931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.519412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.586044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-22c0b95a-b349-4021-b811-c576cfecc5d7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122762 Apr 05 13:48:47.586649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 343/717] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:47 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:47.673712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-d62086af-7710-4fa1-a83b-7a1e7acdc83b req-2593bfa6-8077-4e3c-8d0c-f59a220b2d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458b08fb-48ac-4bec-8f2a-a900c7499671", "tag": "5ce43029-8922-4702-b1d8-44ae015a94ae"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:47.684403 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-d62086af-7710-4fa1-a83b-7a1e7acdc83b req-2593bfa6-8077-4e3c-8d0c-f59a220b2d79 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.685505 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-d62086af-7710-4fa1-a83b-7a1e7acdc83b req-2593bfa6-8077-4e3c-8d0c-f59a220b2d79 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.711968 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:47.713470 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:47.721230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-d62086af-7710-4fa1-a83b-7a1e7acdc83b req-2593bfa6-8077-4e3c-8d0c-f59a220b2d79 service nova] Creating event network-changed:5ce43029-8922-4702-b1d8-44ae015a94ae for instance 458b08fb-48ac-4bec-8f2a-a900c7499671 on hv-cinder-83587 Apr 05 13:48:47.733788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.734257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.735070 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.735549 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.737061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-d62086af-7710-4fa1-a83b-7a1e7acdc83b req-2593bfa6-8077-4e3c-8d0c-f59a220b2d79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067681 Apr 05 13:48:47.738321 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 375/718] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:47.746636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:47.747889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:47.759090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.759731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.760621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:47.761313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:47.954265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:47.964733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-859fce61-df28-4a0e-8c0f-50ad9b7833f0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.257288 Apr 05 13:48:47.965699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 344/719] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:47 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:48.055897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:48.064397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:48.065901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:48.067062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5874b4fc-1591-43a4-a2a4-f3f5a8c682dd tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.326883 Apr 05 13:48:48.067896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 376/720] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:47 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:48.599102 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:48.600034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:48.606685 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.607327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.608355 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.608856 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.649709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ff182142-9f65-49e3-8968-09f66aad4dd7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055187 Apr 05 13:48:48.655819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 345/721] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:48:48 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:48:48.766892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:48.767437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:48.774457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.774992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.775876 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.776384 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.803145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:48:48.888242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4b490482-ba41-4cdb-90b6-262cda9ecff5 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 204 len: 0 microversion: 2.1 time: 0.125481 Apr 05 13:48:48.889058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 377/722] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:48:48 2022] DELETE /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:48:48.897037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:48.897646 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:48.903393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.903888 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.904648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.905078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.982833 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:48.983541 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:48.989828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.990277 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:48.991143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:48.991461 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:49.055384 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:49.075421 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a1373cac-f6da-4c99-8005-d196085b87b2 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1689 microversion: 2.1 time: 0.182277 Apr 05 13:48:49.086012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 346/723] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:48 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:49.090736 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:49.091417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:49.097433 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:49.097889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:49.098745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:49.099187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:49.171051 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:49.181356 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-53507a3d-845c-4e81-bcca-d439be6db618 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.202482 Apr 05 13:48:49.182239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 378/724] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:48 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:48:49.269224 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:49.279271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:49.280814 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:49.281993 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f82136e3-984d-4ef2-a983-a678d47bafcc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.194977 Apr 05 13:48:49.282556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 347/725] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:49 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:50.094037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:50.095310 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:50.103188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.103677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.104456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.105442 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.199259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:50.199910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:50.206834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.207439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.209369 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.210102 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.425376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:50.437058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d4d93902-1bdc-4d09-a16c-bcca389eb137 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.241626 Apr 05 13:48:50.438392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 348/726] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:50 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:50.445880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:50.447020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:50.464119 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.464742 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.465709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:50.466299 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:50.468039 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:50.478121 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1b95b60a-91b3-4ab1-8b03-757c593b8c42 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1689 microversion: 2.1 time: 0.386911 Apr 05 13:48:50.479055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 379/727] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:50 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1689 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:50.645181 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:50.653886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:50.655528 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:50.656726 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4ff73af3-f296-4386-a5f7-196828188a46 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.215580 Apr 05 13:48:50.657495 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 349/728] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:50 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:51.455225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:51.455865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:51.462512 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.462962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.465244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.465776 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.495524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:51.497100 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:51.503642 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.504335 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.505676 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.506357 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.620727 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:51.629443 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6e9495e9-70b6-4588-a24d-7fac4cc1b998 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.178444 Apr 05 13:48:51.630520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 380/729] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:51 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:51.665669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:51.673258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f52891b2-1cca-4c23-a768-77bc59f6bd4b tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1689 microversion: 2.1 time: 0.181854 Apr 05 13:48:51.673820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 350/730] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:51 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:48:51.676107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:51.676804 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:51.682491 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.682942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.683750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:51.684185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:51.822092 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:51.830028 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:51.831678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:51.832707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-80266e1e-7050-4d83-9b95-b4100750d698 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.160538 Apr 05 13:48:51.833490 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 381/731] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:51 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:52.648570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:52.649122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:52.655407 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.655893 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.656665 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.657108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.690095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:52.690705 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:52.697932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.698387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.699236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.699647 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.792225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:52.799653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a559c092-c823-4fa5-b314-a50340222009 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.155723 Apr 05 13:48:52.800234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 351/732] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:52 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:52.840275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:52.848037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-93e5c95d-123e-4999-97c5-8b1562fc2906 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1689 microversion: 2.1 time: 0.161659 Apr 05 13:48:52.849585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 382/733] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:52 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:52.851283 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:52.851921 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:52.857831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.858283 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.859055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:52.859489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:52.996995 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:53.006228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:53.007883 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:53.008940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-71997b95-6e14-4ef5-9fb9-534c5b8f31b6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.162695 Apr 05 13:48:53.009508 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 352/734] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:52 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:48:53.452961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-3a8f1955-86b3-4e3a-ae59-b2759e9ec9dc req-3d989c55-dd7d-4ba9-98b4-d432bccae684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458b08fb-48ac-4bec-8f2a-a900c7499671", "name": "network-vif-plugged", "status": "completed", "tag": "5ce43029-8922-4702-b1d8-44ae015a94ae"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:53.463140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3a8f1955-86b3-4e3a-ae59-b2759e9ec9dc req-3d989c55-dd7d-4ba9-98b4-d432bccae684 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:53.463611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3a8f1955-86b3-4e3a-ae59-b2759e9ec9dc req-3d989c55-dd7d-4ba9-98b4-d432bccae684 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:53.476002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-3a8f1955-86b3-4e3a-ae59-b2759e9ec9dc req-3d989c55-dd7d-4ba9-98b4-d432bccae684 service nova] Creating event network-vif-plugged:5ce43029-8922-4702-b1d8-44ae015a94ae for instance 458b08fb-48ac-4bec-8f2a-a900c7499671 on hv-cinder-83587 Apr 05 13:48:53.481885 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-3a8f1955-86b3-4e3a-ae59-b2759e9ec9dc req-3d989c55-dd7d-4ba9-98b4-d432bccae684 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093595 Apr 05 13:48:53.483676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 383/735] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:53.817692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:53.818239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:53.824262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:53.824723 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:53.825500 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:53.825942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:53.867196 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:53.868800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:53.877421 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:53.877993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:53.878893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:53.879531 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:53.977222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:53.984583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c84ecd61-e0d9-4aaa-acf5-a4a828e3b72e tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.170962 Apr 05 13:48:53.985173 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 353/736] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:53 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:54.028152 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:54.031684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:54.038108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:54.038556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:54.039328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:54.039816 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:54.129015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:54.143776 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1e6e148-6bb1-407c-ad1c-7b71f8d30a36 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1689 microversion: 2.1 time: 0.280891 Apr 05 13:48:54.144882 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 384/737] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:53 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:48:54.186036 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:54.198180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:54.198180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:54.198685 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a39e6531-4cde-4a36-8069-c22c05d82db0 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1744 microversion: 2.20 time: 0.174718 Apr 05 13:48:54.199293 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 354/738] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:54 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:48:54.529198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-184bbb4b-3562-4fc3-813a-7aba8ffd06fd req-be87e9f7-40aa-4379-a8c4-d35075014632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6", "name": "network-vif-deleted", "tag": "6a83c9ab-5780-4a30-99ee-398ef555b022"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:54.537599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-184bbb4b-3562-4fc3-813a-7aba8ffd06fd req-be87e9f7-40aa-4379-a8c4-d35075014632 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:54.538048 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-184bbb4b-3562-4fc3-813a-7aba8ffd06fd req-be87e9f7-40aa-4379-a8c4-d35075014632 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:54.548637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-184bbb4b-3562-4fc3-813a-7aba8ffd06fd req-be87e9f7-40aa-4379-a8c4-d35075014632 service nova] Creating event network-vif-deleted:6a83c9ab-5780-4a30-99ee-398ef555b022 for instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 on hv-cinder-83587 Apr 05 13:48:54.553673 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-184bbb4b-3562-4fc3-813a-7aba8ffd06fd req-be87e9f7-40aa-4379-a8c4-d35075014632 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028084 Apr 05 13:48:54.554267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 385/739] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:55.001467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:55.003469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:55.013826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.014527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.015874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.016557 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.163687 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:55.164139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:55.164842 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:55.171901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.172435 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.173213 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.173663 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b534f609-297b-47aa-81f3-9b34fbfe5216 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1366 microversion: 2.1 time: 0.175751 Apr 05 13:48:55.173830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.174291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 355/740] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:54 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:55.208043 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.208520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.208937 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lazy-loading 'fault' on Instance uuid 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:48:55.217826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:55.218427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:55.224677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.225625 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.226609 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:55.227234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:55.316142 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:55.334837 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-13fedb4f-a84b-4479-8485-a4b01fda7cf8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 200 len: 1336 microversion: 2.1 time: 0.175845 Apr 05 13:48:55.337858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 386/741] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:55 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 1336 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:55.416181 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:55.429585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:55.431344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:55.432596 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bc49d0f9-77f1-468d-83af-f71e199e82c5 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1744 microversion: 2.20 time: 0.218631 Apr 05 13:48:55.442619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 356/742] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:55 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:48:56.191131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:56.192480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:56.199340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.199959 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.200741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.201175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.344451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:56.353923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:56.354487 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-678e4a1b-c4e3-46ed-9322-dc67daa7f20f tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1557 microversion: 2.1 time: 0.167358 Apr 05 13:48:56.354824 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:56.366278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 387/743] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:56 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:48:56.367229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.367229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.367229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.367229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.375609 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:56.376109 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:56.377366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] HTTP exception thrown: Instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 could not be found. Apr 05 13:48:56.377981 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Returning 404 to user: Instance 9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:48:56.378831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-eba4c7a6-b9e1-48d2-b975-69e7410d831d tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6" status: 404 len: 111 microversion: 2.1 time: 0.029112 Apr 05 13:48:56.383234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 357/744] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:48:56 2022] GET /compute/v2.1/servers/9ff5ed31-8477-433b-8dc9-1e5ee82ca6b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:48:56.385222 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.385685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.386480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.386918 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.389733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c6d7b9a2-e096-49ac-86d5-ca60b73b9626 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '.version_select at 0x7f9bfd7ab0d0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:56.408574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c6d7b9a2-e096-49ac-86d5-ca60b73b9626 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093365855" status: 202 len: 0 microversion: 2.1 time: 0.022569 Apr 05 13:48:56.409439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 358/745] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Apr 5 13:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093365855 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:48:56.453893 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:56.454821 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:56.462314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.462773 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.463783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:56.464228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:56.515182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a692a355-2e1b-4ce7-92ba-af7652ef9ba6 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143537 Apr 05 13:48:56.515895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 388/746] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:48:56 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:56.639423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:56.653533 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:56.656368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:56.658021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-88aa5f6d-1a33-4270-859f-4c70a19a7ce8 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.208005 Apr 05 13:48:56.659484 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 359/747] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:56 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:57.460733 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-e03b0f6e-21c3-4ee5-ae5d-1f420c65a678 req-e5a95138-688b-4cb7-b934-91a3f2cdf575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "name": "network-vif-plugged", "status": "completed", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:57.483375 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e03b0f6e-21c3-4ee5-ae5d-1f420c65a678 req-e5a95138-688b-4cb7-b934-91a3f2cdf575 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:57.485052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e03b0f6e-21c3-4ee5-ae5d-1f420c65a678 req-e5a95138-688b-4cb7-b934-91a3f2cdf575 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:57.531353 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-e03b0f6e-21c3-4ee5-ae5d-1f420c65a678 req-e5a95138-688b-4cb7-b934-91a3f2cdf575 service nova] Creating event network-vif-plugged:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:48:57.551858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-e03b0f6e-21c3-4ee5-ae5d-1f420c65a678 req-e5a95138-688b-4cb7-b934-91a3f2cdf575 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095352 Apr 05 13:48:57.553474 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 389/748] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:57.678141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:57.678744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:57.687241 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:57.687722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:57.689230 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:57.689827 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:57.855823 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:57.865673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:57.867763 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:57.870063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2753ef13-d9e0-462c-ab4a-453b872c64cc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.196273 Apr 05 13:48:57.880849 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 360/749] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:57 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:48:58.308911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-74095008-ea64-42a6-a0dc-56a3229c05ce req-9691b391-8dc2-4cd6-b9a1-99ce89179065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458b08fb-48ac-4bec-8f2a-a900c7499671", "tag": "5ce43029-8922-4702-b1d8-44ae015a94ae"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:48:58.319296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-74095008-ea64-42a6-a0dc-56a3229c05ce req-9691b391-8dc2-4cd6-b9a1-99ce89179065 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:58.320135 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-74095008-ea64-42a6-a0dc-56a3229c05ce req-9691b391-8dc2-4cd6-b9a1-99ce89179065 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:58.333480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-74095008-ea64-42a6-a0dc-56a3229c05ce req-9691b391-8dc2-4cd6-b9a1-99ce89179065 service nova] Creating event network-changed:5ce43029-8922-4702-b1d8-44ae015a94ae for instance 458b08fb-48ac-4bec-8f2a-a900c7499671 on hv-cinder-83587 Apr 05 13:48:58.339548 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-74095008-ea64-42a6-a0dc-56a3229c05ce req-9691b391-8dc2-4cd6-b9a1-99ce89179065 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Apr 05 13:48:58.341120 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 390/750] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:48:58.889482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:48:58.890096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:48:58.910497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:58.912582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:58.915177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:48:58.915931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:48:59.183946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:59.193575 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:59.195017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:48:59.196330 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b489d5fe-1b0d-4a22-91b9-d2a0f64e4e08 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.311376 Apr 05 13:48:59.197092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 361/751] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:48:58 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:00.082906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:00.083806 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:00.092163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.093176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.094254 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.094916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.121832 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:49:00.213864 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1a4e6225-86e5-40cf-a1ee-75b5badb67e6 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 204 len: 0 microversion: 2.1 time: 0.135629 Apr 05 13:49:00.215023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 391/752] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:00 2022] DELETE /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:49:00.218118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:00.219511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:00.227327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:00.231089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.232614 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.233482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.233994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.236292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:00.249070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.250763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.251847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:00.252445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:00.386988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:00.401943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:00.403423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:00.404888 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d44d2a4d-f7ea-44a8-bc3c-5ec1da8a5355 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.194249 Apr 05 13:49:00.406046 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 362/753] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:00 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:00.448898 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:00.456961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5ff6eb7d-42c1-4e7c-951c-edf27a9e2ba9 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1506 microversion: 2.1 time: 0.237767 Apr 05 13:49:00.457814 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 392/754] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:00 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:01.423222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:01.423872 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:01.436362 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:01.437022 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:01.438031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:01.438629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:01.475907 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:01.477245 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:01.497410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:01.497884 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:01.498697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:01.499143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:01.626266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:01.635183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:01.636721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:01.637900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-90299b6c-2ab2-4260-bc1b-b83bcfdf741f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.218546 Apr 05 13:49:01.648569 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 363/755] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:01 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:01.685849 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:01.694224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5ee6f1de-2569-4827-b715-d8bd180ba11a tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1506 microversion: 2.1 time: 0.223270 Apr 05 13:49:01.694960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 393/756] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:01 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:02.657430 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:02.657864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:02.665290 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:02.665995 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:02.666944 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:02.667387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:02.712445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:02.713684 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:02.734038 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:02.734522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:02.738036 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:02.746301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:02.850558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:02.868078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:02.870199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:02.871882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-871d5c46-d687-4ee9-9389-0f0198644259 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.218708 Apr 05 13:49:02.883796 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 364/757] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:02 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:02.889270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-88f3ad7e-2dd9-4deb-8848-88e0a3058761 req-06b56eaa-cfd3-4345-9236-45c36b763db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01eed230-0576-46ce-89ed-577fe3bafe14", "name": "network-vif-deleted", "tag": "5e0130be-6ae6-413d-a3ae-c2ae43b030f9"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:02.898647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-88f3ad7e-2dd9-4deb-8848-88e0a3058761 req-06b56eaa-cfd3-4345-9236-45c36b763db3 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:02.899338 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-88f3ad7e-2dd9-4deb-8848-88e0a3058761 req-06b56eaa-cfd3-4345-9236-45c36b763db3 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:02.908735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:02.918326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-51ffcb0f-13b3-41f9-ab32-df7cb9920dfb tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 200 len: 1464 microversion: 2.1 time: 0.210743 Apr 05 13:49:02.918923 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 394/758] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:02 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:02.933160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-88f3ad7e-2dd9-4deb-8848-88e0a3058761 req-06b56eaa-cfd3-4345-9236-45c36b763db3 service nova] Creating event network-vif-deleted:5e0130be-6ae6-413d-a3ae-c2ae43b030f9 for instance 01eed230-0576-46ce-89ed-577fe3bafe14 on hv-cinder-83587 Apr 05 13:49:02.942394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-88f3ad7e-2dd9-4deb-8848-88e0a3058761 req-06b56eaa-cfd3-4345-9236-45c36b763db3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056438 Apr 05 13:49:02.948194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 365/759] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:03.671318 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-585725031", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2080643478", "security_groups": [{"name": "tempest-secgroup-smoke-581162300"}], "block_device_mapping_v2": [{"uuid": "9474d963-de9c-4174-ad57-1358bb7bccdf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:03.808481 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] validate_networks() for [('d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:49:03.891048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:03.892907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:03.905843 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:03.906294 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:03.907082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:03.907553 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.072841 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:04.085774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:04.087377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:04.088937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5b5e412b-6371-4835-85ce-344ccbed0505 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.202245 Apr 05 13:49:04.099531 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 366/760] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:03 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:04.099531 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:04.099531 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: 01eed230-0576-46ce-89ed-577fe3bafe14] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:04.106115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.106562 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.108056 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.108767 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.127457 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] HTTP exception thrown: Instance 01eed230-0576-46ce-89ed-577fe3bafe14 could not be found. Apr 05 13:49:04.128362 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Returning 404 to user: Instance 01eed230-0576-46ce-89ed-577fe3bafe14 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:04.129916 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-847aba38-32f3-404f-8a07-119583a68fc7 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14" status: 404 len: 111 microversion: 2.1 time: 0.038425 Apr 05 13:49:04.130473 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 367/761] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:04 2022] GET /compute/v2.1/servers/01eed230-0576-46ce-89ed-577fe3bafe14 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:04.138389 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:04.139239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:04.147421 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.148157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.149284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.149880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.177858 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:49:04.271364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1a4312c1-4323-40f8-a24d-c033cb564d15 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 204 len: 0 microversion: 2.1 time: 0.134045 Apr 05 13:49:04.273423 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 368/762] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:04 2022] DELETE /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:49:04.283485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:04.285664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:04.292654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.293740 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.294760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.295378 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.299845 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:49:04.300275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:49:04.300741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:49:04.301731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:49:04.302751 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:49:04.312523 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.313317 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.314491 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:04.315264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:04.336368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:49:04.343774 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for user 507ec53c995341ce805d43f85a4d72c3 and project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:49:04.412888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:49:04.415171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9474d963-de9c-4174-ad57-1358bb7bccdf',volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:49:04.467335 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:04.481155 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-71616874-3032-4a13-b3e6-1f4fc676358f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.203493 Apr 05 13:49:04.482641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 369/763] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:04 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:04.587924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-95280fa4-7dcc-4b70-9016-2e339e63279d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.920761 Apr 05 13:49:04.588651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 395/764] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:49:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:49:04.600915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c0ae17c0-120d-4817-bfcc-d35bc4195157 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:04.603132 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c0ae17c0-120d-4817-bfcc-d35bc4195157 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:04.666747 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c0ae17c0-120d-4817-bfcc-d35bc4195157 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:04.673732 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c0ae17c0-120d-4817-bfcc-d35bc4195157 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1094 microversion: 2.1 time: 0.077430 Apr 05 13:49:04.683972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 370/765] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:04 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:05.112020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:05.113323 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:05.121851 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.123864 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.125674 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.126360 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.287395 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:05.295960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:05.297764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:05.299654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dcf92f35-1e9f-4cf2-ae25-df5c6bf592bf tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.191764 Apr 05 13:49:05.300447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 396/766] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:05 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:05.500163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:05.500900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:05.508004 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.508464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.509245 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.509684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.666376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:05.677160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cd44ba25-773d-4e2d-84a0-11010b4f4a3f tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.180785 Apr 05 13:49:05.677758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 371/767] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:05 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:05.693655 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:05.694551 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:05.700836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.701471 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.702258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:05.702736 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:05.792498 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:05.804668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ac9c850-16d3-464f-85ad-98a83b723a79 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1144 microversion: 2.1 time: 0.115362 Apr 05 13:49:05.805293 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 397/768] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:05 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1144 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:06.321910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:06.322878 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:06.329063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.329598 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.330499 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.331058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.482345 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:06.495546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:06.495546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:06.496184 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b8fcbb67-3c8e-4633-940a-d7636a3831af tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.180816 Apr 05 13:49:06.496772 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 372/769] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:06 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:06.697652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:06.698335 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:06.704771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.705218 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.706239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.707354 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.821311 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:06.821924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:06.828900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.829358 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.830141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:06.830582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:06.883387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:06.892410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7091034f-9663-4266-93a7-dec9ad7f9c5e tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1521 microversion: 2.1 time: 0.198551 Apr 05 13:49:06.894922 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 398/770] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:06 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:06.913638 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:06.921557 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c25d4c5f-ded2-472d-8487-c30bb1ebb9c4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1136 microversion: 2.1 time: 0.104147 Apr 05 13:49:06.922204 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 373/771] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:06 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1136 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:07.514032 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:07.514639 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:07.521366 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.521815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.522590 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.523024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.759603 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:07.771544 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:07.773718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:07.775205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-84b829da-f323-4f63-adf1-9d9fe575a65a tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1739 microversion: 2.20 time: 0.265057 Apr 05 13:49:07.776470 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 399/772] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:07 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:07.915254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:07.918861 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:07.927797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.928493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.929522 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.929967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.940428 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:07.941147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:07.947766 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.948349 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.949209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:07.949764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:07.996027 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24d703a07794f56b600cc29c0a1578d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2098c6086f1416bacaabd9ec938bfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:08.003911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b503ecbd-dbae-4c0e-ac73-107b48051994 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 200 len: 1479 microversion: 2.1 time: 0.094066 Apr 05 13:49:08.005004 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 374/773] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:07 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 1479 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:08.013094 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-b439a3bf-6a9a-49d7-9327-2b26d55f064e req-c71a86e7-8034-4a82-98d0-51cb9c97b472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ef91a-434a-4c31-85d2-c1352a5208f3", "name": "network-vif-deleted", "tag": "2b817a5d-3997-48f5-8143-c7c5935059ae"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:08.021615 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b439a3bf-6a9a-49d7-9327-2b26d55f064e req-c71a86e7-8034-4a82-98d0-51cb9c97b472 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:08.022146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b439a3bf-6a9a-49d7-9327-2b26d55f064e req-c71a86e7-8034-4a82-98d0-51cb9c97b472 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:08.031405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:08.033783 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-b439a3bf-6a9a-49d7-9327-2b26d55f064e req-c71a86e7-8034-4a82-98d0-51cb9c97b472 service nova] Creating event network-vif-deleted:2b817a5d-3997-48f5-8143-c7c5935059ae for instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 on hv-cinder-83587 Apr 05 13:49:08.039697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-b439a3bf-6a9a-49d7-9327-2b26d55f064e req-c71a86e7-8034-4a82-98d0-51cb9c97b472 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030834 Apr 05 13:49:08.040546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 375/774] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:49:08.040682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-243efbf5-4c67-4dd5-bfea-075237d77ff3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1210 microversion: 2.1 time: 0.104040 Apr 05 13:49:08.041111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 400/775] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:07 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:08.797930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:08.798758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:08.806762 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:08.807243 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:08.808126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:08.808570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:08.952319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:08.961579 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:08.963078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:08.964279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d445740d-fba0-4fd1-9449-09049540509d tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1721 microversion: 2.20 time: 0.170581 Apr 05 13:49:08.964839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 376/776] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:08 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:49:09.021457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:09.022791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] [instance: ec3ef91a-434a-4c31-85d2-c1352a5208f3] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:09.029356 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.029804 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:09.030572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.031004 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:09.045297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] HTTP exception thrown: Instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 could not be found. Apr 05 13:49:09.046040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] Returning 404 to user: Instance ec3ef91a-434a-4c31-85d2-c1352a5208f3 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:09.046892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-917b5696-7a9e-4c9e-b479-b475feda47a8 tempest-ServerRescueNegativeTestJSON-926369942 tempest-ServerRescueNegativeTestJSON-926369942-project] 10.222.0.59 "GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3" status: 404 len: 111 microversion: 2.1 time: 0.029482 Apr 05 13:49:09.053379 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 401/777] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:09 2022] GET /compute/v2.1/servers/ec3ef91a-434a-4c31-85d2-c1352a5208f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:09.060641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:09.061185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:09.067026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.067673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:09.068452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.069074 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:09.317399 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:09.326935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-16005626-9e96-497d-8511-6295718aaa52 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.270214 Apr 05 13:49:09.328187 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 377/778] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:09 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:09.984093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:09.984710 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:09.990874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.991319 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:09.993237 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:09.993680 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:10.071452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-6af744ba-9401-4fa0-a67c-4d192cea2400 req-570512c8-3292-4766-9b19-2eb997523b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e672018-0182-4460-8378-999578b50317", "tag": "cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:10.084050 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6af744ba-9401-4fa0-a67c-4d192cea2400 req-570512c8-3292-4766-9b19-2eb997523b6c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:10.084924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6af744ba-9401-4fa0-a67c-4d192cea2400 req-570512c8-3292-4766-9b19-2eb997523b6c service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:10.096221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-6af744ba-9401-4fa0-a67c-4d192cea2400 req-570512c8-3292-4766-9b19-2eb997523b6c service nova] Creating event network-changed:cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94 for instance 4e672018-0182-4460-8378-999578b50317 on hv-cinder-83587 Apr 05 13:49:10.101511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-6af744ba-9401-4fa0-a67c-4d192cea2400 req-570512c8-3292-4766-9b19-2eb997523b6c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036111 Apr 05 13:49:10.102422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 378/779] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:49:10.159613 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:10.167398 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:10.168914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:10.170079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7f1d9b92-8915-4151-a3bf-530b9773c678 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1721 microversion: 2.20 time: 0.190016 Apr 05 13:49:10.170643 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 402/780] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:09 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:10.345956 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:10.346643 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:10.352987 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:10.353432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:10.354195 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:10.354623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:10.599550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:10.607902 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d70fd873-6273-4599-8925-cc51fc222e23 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.266259 Apr 05 13:49:10.608583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 379/781] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:10 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:11.190534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:11.191100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:11.203125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:11.204246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:11.205252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:11.205892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:11.515238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:11.524474 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:11.526088 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:11.527333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-395d81a4-053d-4a15-a5b4-395f42cce325 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1721 microversion: 2.20 time: 0.340870 Apr 05 13:49:11.538524 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 403/782] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:11 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:11.605618 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-ebefbba5-9857-46e5-a870-dde68f43ca3a req-1ff15bb1-3df4-4360-8c72-fe6f78e62cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "name": "network-vif-unplugged", "status": "completed", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:11.615091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ebefbba5-9857-46e5-a870-dde68f43ca3a req-1ff15bb1-3df4-4360-8c72-fe6f78e62cf3 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:11.615849 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ebefbba5-9857-46e5-a870-dde68f43ca3a req-1ff15bb1-3df4-4360-8c72-fe6f78e62cf3 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:11.625052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:11.625666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:11.632148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-ebefbba5-9857-46e5-a870-dde68f43ca3a req-1ff15bb1-3df4-4360-8c72-fe6f78e62cf3 service nova] Creating event network-vif-unplugged:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:49:11.638183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-ebefbba5-9857-46e5-a870-dde68f43ca3a req-1ff15bb1-3df4-4360-8c72-fe6f78e62cf3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036508 Apr 05 13:49:11.638995 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 380/783] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:11.640768 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:11.641182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:11.641962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:11.642434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.240200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:12.247662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a283b84c-d26f-409e-a016-4d55a9d0a6d6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.626439 Apr 05 13:49:12.248239 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 404/784] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:11 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:12.546697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:12.547582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:12.553910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.554476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.555313 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.555784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.674012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:12.674964 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:12.682693 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.683478 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.685749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.686186 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.709195 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:12.719297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lazy-loading 'flavor' on Instance uuid 5774fdc2-d449-49b9-837c-a4e9695da6b6 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:49:12.722649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:12.725982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:12.727183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-124e10e3-7d48-49f3-afb9-574d5dce9557 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1664 microversion: 2.20 time: 0.184779 Apr 05 13:49:12.740128 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 381/785] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:12 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:12.745766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09366435-a290-4037-b985-c68530c9d9b2"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:12.746850 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:12.753062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.753445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.754756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.755479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.817220 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5cf7ef81-d665-47d5-af81-9248989c6f99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "POST /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6/action" status: 202 len: 0 microversion: 2.1 time: 0.145850 Apr 05 13:49:12.818389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 405/786] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:49:12 2022] POST /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:49:12.827322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:12.828155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:12.835869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.836485 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:12.837386 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:12.837853 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.102397 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-675f39bc-eaab-42e1-b401-88a432e5f3aa tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360276 Apr 05 13:49:13.103092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 382/787] 10.222.0.59 () {62 vars in 1363 bytes} [Tue Apr 5 13:49:12 2022] POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 13:49:13.179550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:13.190530 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0203f256-3f50-4004-b9e3-28e4160633d3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.368019 Apr 05 13:49:13.191119 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 406/788] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:12 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:13.233570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:13.234163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:13.245215 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.245666 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.246443 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.246885 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.264140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:13.265431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:13.272528 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.273264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.274264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.274911 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.449240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:13.466813 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2e8fe3d6-59d2-4d50-ab68-93fc9882c38b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.206430 Apr 05 13:49:13.479358 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 407/789] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:13 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:13.532251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a0b839aa-cfe4-4da8-b0e1-a2bf2e3f6b13 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments/09366435-a290-4037-b985-c68530c9d9b2" status: 202 len: 0 microversion: 2.20 time: 0.302715 Apr 05 13:49:13.533160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 383/790] 10.222.0.59 () {60 vars in 1456 bytes} [Tue Apr 5 13:49:13 2022] DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments/09366435-a290-4037-b985-c68530c9d9b2 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:49:13.610276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:13.610848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:13.617851 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.618306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.619079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.619540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.719899 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4222fe1e-e8f2-4548-a7f2-9306635601a2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/action" status: 202 len: 0 microversion: 2.20 time: 0.113438 Apr 05 13:49:13.739623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:13.740383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:13.743546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 408/791] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Apr 5 13:49:13 2022] POST /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:49:13.746750 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.747205 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:13.748024 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:13.748611 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:14.002014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:14.010949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:14.013344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:14.014799 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b6518e77-f82f-4f9e-8eb6-3b42b1d25c51 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1672 microversion: 2.20 time: 0.280645 Apr 05 13:49:14.015435 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 384/792] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:13 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1672 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:14.210058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:14.210681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:14.217244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:14.217568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:14.218630 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:14.219075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:14.409286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:14.418195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-599bded6-6ea9-4cf5-9e4e-f7f3b154301c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.213085 Apr 05 13:49:14.419344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 409/793] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:14 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:14.487060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:14.488183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:14.495416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:14.496111 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:14.497653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:14.498161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:14.638629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:14.645992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-92392ccc-4ca8-4ca6-bdec-b26095b316c6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.163135 Apr 05 13:49:14.646563 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 385/794] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:14 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:15.034648 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:15.035879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:15.045875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.048051 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.049117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.051649 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.272207 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:15.281872 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:15.283379 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:15.284577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e72ef48f-4465-4d4a-a934-ab32cd8b5eec tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.254107 Apr 05 13:49:15.286244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 410/795] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:15 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:15.440840 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:15.441896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:15.452241 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.452693 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.453631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.454587 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.663525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:15.665238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:15.670645 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.671838 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.672280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:15.672972 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:15.724852 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:15.732437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec5a8cdd-f029-487a-8869-dc63cdb1ee78 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.299578 Apr 05 13:49:15.733234 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 386/796] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:15 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:15.839145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:15.849361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0633d9a1-b175-4a38-be25-ee3b17692002 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.190462 Apr 05 13:49:15.850646 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 411/797] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:15 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:16.305558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:16.306180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:16.313494 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.313952 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:16.317202 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.319597 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:16.706140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:16.715001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:16.716550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:16.717738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b01d4070-9139-4712-8d8d-596140580a0e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.416292 Apr 05 13:49:16.724937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 387/798] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:16 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:16.750342 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:16.753149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:16.761626 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.762389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:16.763569 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.764225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:16.868023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:16.868646 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:16.878478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.881640 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:16.882529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:16.882986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:17.098583 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:17.116440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7223de3b-8b8c-4037-bb14-258857f95a57 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.369931 Apr 05 13:49:17.118893 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 412/799] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:16 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:17.319412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:17.343617 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-24dfe600-2c79-4850-9fd3-4defd7a2c578 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.480721 Apr 05 13:49:17.346488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 388/800] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:16 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:17.738507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:17.739546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:17.753672 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:17.755328 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:17.758024 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:17.759355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:17.990127 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:18.017391 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:18.026303 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:18.027844 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-574817fe-c40d-41d5-b1f6-9faea1bb284f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.295124 Apr 05 13:49:18.029143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 413/801] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:17 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:18.136251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:18.137037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:18.154346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:18.155164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:18.156272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:18.156949 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:18.364535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:18.365140 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:18.386052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:18.386515 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:18.388477 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:18.389248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:18.698830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:18.706704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e828af36-d94a-4b3b-abea-b7baec79f56b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.347560 Apr 05 13:49:18.714678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 414/802] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:18 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:18.805668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:18.820873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-00afc153-6602-473b-9496-f017ef8af083 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.688754 Apr 05 13:49:18.823659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 389/803] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:18 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:19.054783 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:19.055409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:19.061791 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.068990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.070136 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.070699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.329281 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:19.341085 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:19.343045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:19.344514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3610b233-2c93-43c6-bfb5-3fb74d75709e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.294595 Apr 05 13:49:19.345657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 415/804] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:19 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:19.731046 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:19.731681 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:19.746054 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.746791 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.748459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.749081 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.839861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:19.840493 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:19.849824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.850542 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.855380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:19.855998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:19.996225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:20.006425 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-56a38459-bca9-4060-942d-e5ff0c1e49cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.278750 Apr 05 13:49:20.016085 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 390/805] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:19 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:20.214118 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:20.228730 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9aa48f4c-6192-4ebf-b932-78e9fe32142c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.392883 Apr 05 13:49:20.230001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 416/806] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:19 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:20.368302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:20.369058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:20.375350 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:20.375834 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:20.378109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:20.378446 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:20.708194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:20.716548 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:20.718265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:20.719471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f215520e-554e-49cb-b434-4cb86cca3cf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.356324 Apr 05 13:49:20.732089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 391/807] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:20 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:21.024638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:21.025252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:21.042876 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.043334 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:21.044162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.044601 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:21.247353 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:21.248023 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:21.256432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.257835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:21.259267 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.259984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:21.487068 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:21.501675 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-66ea3d26-73b5-4bf4-982c-53f878d5ec3f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.258191 Apr 05 13:49:21.512886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 392/808] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:21 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:21.547754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:21.563093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-41d9ece0-702e-44d4-abe5-9764c468ee37 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.542291 Apr 05 13:49:21.563984 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 417/809] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:21 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:21.753701 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:21.754321 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:21.762644 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.766976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:21.777011 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:21.777738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:22.108590 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:22.124657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:22.126488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:22.127952 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-91a2c2b9-ccc5-460d-a940-0b86266f662e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.379545 Apr 05 13:49:22.129389 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 393/810] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:21 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:22.521666 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:22.522381 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:22.529355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:22.530089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:22.531117 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:22.531810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:22.583719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:22.584664 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:22.606162 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:22.606803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:22.608344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:22.609013 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:22.892610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:22.897047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:22.902655 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e7eab223-0533-42fe-85e7-92d8ffe07c45 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.385226 Apr 05 13:49:22.904080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 418/811] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:22 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:22.905935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-72f88d79-34f8-49ff-b903-969e4004de0e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.327911 Apr 05 13:49:22.906509 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 394/812] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:22 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:23.047813 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: .version_select at 0x7f9bfd9aa790>, body: {"keypair": {"name": "tempest-keypair-67238975"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:23.087000 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:49:23.094886 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:49:23.146451 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:23.147653 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:23.157825 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.159349 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:23.165650 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.166452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:23.443463 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:23.452692 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:23.460105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:23.461597 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ce0a837-462f-4179-a3a8-2db7ea99615b tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.319091 Apr 05 13:49:23.465002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 395/813] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:23 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:23.526594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:49:23.535658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:49:23.569276 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-866ccd34-c0bf-4e50-a614-840bca0e06f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.663905 Apr 05 13:49:23.570737 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 419/814] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:49:22 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:23.921527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:23.922148 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:23.924184 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:23.924869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:23.933810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.934068 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.934297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:23.934877 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:23.935092 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.935555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:23.936222 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:23.936859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:24.103428 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:24.121206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ee5c430-4244-4c0a-b6b8-10e937d46a4e tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.197622 Apr 05 13:49:24.121206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 396/815] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:23 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:24.154018 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:24.165620 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e592452e-3b25-4f5e-b15a-d8a1d89d8b78 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.245113 Apr 05 13:49:24.167411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 420/816] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:23 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:24.482160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:24.483025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:24.490417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:24.491109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:24.492080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:24.492667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:24.732649 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:24.746071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:24.747838 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:24.749302 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-650cc1f7-0f7b-4f4c-9ee3-590b2f9ac1f7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.271030 Apr 05 13:49:24.750703 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 397/817] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:24 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:25.132889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:25.133492 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:25.141958 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.146211 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.153087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1211369383", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a7d363c-9c87-49b2-bb34-1ae457fa3d44"}], "security_groups": [{"name": "tempest-securitygroup--333203649"}], "key_name": "tempest-keypair-67238975", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:25.160900 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.162389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.279146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] validate_networks() for [('6a7d363c-9c87-49b2-bb34-1ae457fa3d44', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:49:25.315384 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:25.324962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-37aceef3-2438-4de3-b527-031442797431 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.195838 Apr 05 13:49:25.325547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 421/818] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:25 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:25.330472 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:25.331343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:25.338228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.338760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.339661 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.340159 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.568599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:25.576407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cd91a47f-2d31-4e62-a88b-21d0c7b24a7b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.249522 Apr 05 13:49:25.576990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 422/819] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:25 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:25.747700 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:49:25.748678 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:49:25.749181 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:49:25.749585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:49:25.749996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:49:25.759475 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.760209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.761323 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.761758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.769175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:25.770037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:25.779108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:49:25.786026 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.786413 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:49:25.789455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.807394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:25.818111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:25.839223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:49:25.844232 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:49:25.905326 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-52ea91f6-e1e8-4e41-aed1-994a0128079d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.756601 Apr 05 13:49:25.906186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 398/820] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:49:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:49:25.917374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bfbe6b71-93ed-480c-a0e2-6550a013eb60 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:25.918097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bfbe6b71-93ed-480c-a0e2-6550a013eb60 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:25.990985 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bfbe6b71-93ed-480c-a0e2-6550a013eb60 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:25.998768 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bfbe6b71-93ed-480c-a0e2-6550a013eb60 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1236 microversion: 2.1 time: 0.085888 Apr 05 13:49:25.999758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 399/821] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:25 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:26.062185 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:26.070884 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:26.072409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:26.075041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dc4fc7b9-e98d-418e-a896-75f12049ea62 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.310498 Apr 05 13:49:26.076297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 423/822] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:25 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:49:26.342677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:26.343306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:26.351478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:26.352464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:26.353672 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:26.354194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:26.534719 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:26.547239 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0a30b112-f980-4c43-9e45-dbcd1006056b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.208705 Apr 05 13:49:26.548120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 400/823] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:26 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:26.593315 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:26.594537 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:26.603274 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:26.604254 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:26.605212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:26.605807 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:26.796023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:26.804089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b607192e-9a48-43ab-bb09-63e2d7e1b22e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.214665 Apr 05 13:49:26.804667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 424/824] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:26 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:27.015452 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:27.016086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:27.022006 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.022336 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.023097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.023555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.091374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.094123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:27.094932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:27.100757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9673e873-22df-4772-94d1-bedab75ffc18 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1288 microversion: 2.1 time: 0.088609 Apr 05 13:49:27.101542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 401/825] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:27 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:27.110410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.110410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.110709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.110973 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.251820 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.260409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.261894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.263058 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b0fe1665-d90c-4084-ae1c-a2d2bed6396e tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.172846 Apr 05 13:49:27.263651 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 425/826] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:27 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:49:27.572874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:27.573486 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:27.580296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.580745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.582182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.582626 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.717690 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.725483 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7af27e99-8111-408b-bcef-f5c5e8ee57df tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.156124 Apr 05 13:49:27.726061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 402/827] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:27 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:27.821795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:27.822314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:27.828565 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.829014 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.829780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:27.830219 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:27.970520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:27.978360 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cd08634d-5039-40e5-b1bc-abef8d2a9512 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.160660 Apr 05 13:49:27.978936 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 426/828] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:27 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:28.119438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:28.119992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:28.125826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.126346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.127104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.127558 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.186705 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:28.195306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-045f9559-4fd7-4255-95fd-6b8052b6832b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1288 microversion: 2.1 time: 0.079705 Apr 05 13:49:28.195921 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 403/829] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:28 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:28.281717 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:28.287562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:28.298946 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.304362 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.305392 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.305910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.529970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:28.538669 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:28.539992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:28.541473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-835ea694-000f-422d-b9f6-ac7169235e98 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.263552 Apr 05 13:49:28.553756 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 427/830] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:28 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:28.743091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:28.743819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:28.750079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.750524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.751296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:28.751759 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:28.905091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:28.913895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bc441fa2-da4a-4dfe-8f5c-ca7e3d82a963 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.174860 Apr 05 13:49:28.914875 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 404/831] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:28 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:28.994828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:28.995450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:29.001772 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.002212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.002977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.003488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.212550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:29.213432 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:29.220907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.221359 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.223214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.223917 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.286952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:29.304408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-747f16f4-0690-4053-8898-2b04873374cb tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.313647 Apr 05 13:49:29.305011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 428/832] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:28 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:29.407961 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:29.417534 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f8fba257-e024-46d9-a5a7-625e2cb14dcd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.208999 Apr 05 13:49:29.418480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 405/833] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:29 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:29.561107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:29.561723 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:29.568915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.569635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.570452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.571055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.585175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-1d52ff81-5c29-4942-89cf-1b7ad1a609da req-aeebb256-8aa3-48e4-8cd9-31ef7da88239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "name": "network-vif-plugged", "status": "completed", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:29.603117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1d52ff81-5c29-4942-89cf-1b7ad1a609da req-aeebb256-8aa3-48e4-8cd9-31ef7da88239 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.603758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1d52ff81-5c29-4942-89cf-1b7ad1a609da req-aeebb256-8aa3-48e4-8cd9-31ef7da88239 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.620686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-1d52ff81-5c29-4942-89cf-1b7ad1a609da req-aeebb256-8aa3-48e4-8cd9-31ef7da88239 service nova] Creating event network-vif-plugged:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:49:29.626349 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-1d52ff81-5c29-4942-89cf-1b7ad1a609da req-aeebb256-8aa3-48e4-8cd9-31ef7da88239 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046617 Apr 05 13:49:29.627182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 406/834] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:49:29.916703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:29.932566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:29.933983 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:29.935855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:29.939076 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:29.941629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.941781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-00ef65ea-4023-4300-b05f-b08a3d7703d6 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.384053 Apr 05 13:49:29.942523 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.943583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:29.944281 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:29.949695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 429/835] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:29 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:30.095480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:30.104285 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4d8e5c14-e490-49c7-a6f3-ec74786a9d85 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1509 microversion: 2.1 time: 0.176284 Apr 05 13:49:30.104873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 407/836] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:29 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:30.125291 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:30.125869 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:30.137997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.138446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.138647 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-a80049fc-6b9c-4935-8312-d9ca6165c4da req-04cdb663-a78b-42d9-be2b-a700f0b13156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e769137-37bf-4cb2-b020-d664054c61b0", "tag": "68b098ba-9acc-40b2-a9c1-81e4551c96cc"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:30.139226 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.139714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.150374 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a80049fc-6b9c-4935-8312-d9ca6165c4da req-04cdb663-a78b-42d9-be2b-a700f0b13156 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.151486 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a80049fc-6b9c-4935-8312-d9ca6165c4da req-04cdb663-a78b-42d9-be2b-a700f0b13156 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.164449 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-a80049fc-6b9c-4935-8312-d9ca6165c4da req-04cdb663-a78b-42d9-be2b-a700f0b13156 service nova] Creating event network-changed:68b098ba-9acc-40b2-a9c1-81e4551c96cc for instance 9e769137-37bf-4cb2-b020-d664054c61b0 on hv-cinder-83587 Apr 05 13:49:30.170197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-a80049fc-6b9c-4935-8312-d9ca6165c4da req-04cdb663-a78b-42d9-be2b-a700f0b13156 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035926 Apr 05 13:49:30.171569 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 408/837] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:30.223524 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5ab6899b-b804-410f-98f5-4fc8cd190173 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "POST /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6/action" status: 202 len: 0 microversion: 2.1 time: 0.105713 Apr 05 13:49:30.225086 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 430/838] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:49:30 2022] POST /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:49:30.233113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:30.233880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:30.240809 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.241478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.242430 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.243058 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.341327 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:30.344974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:30.358678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.361871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.365137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.365670 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.410512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:30.418236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1c4dc44e-6f09-4d38-85a3-cfdcac95550d tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1517 microversion: 2.1 time: 0.189172 Apr 05 13:49:30.418915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 409/839] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:30 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:30.442190 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:30.443059 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:30.449132 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.449584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.450351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.450948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.601157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:30.609366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8d5b7a4f-925b-4a3d-8508-c384224ce133 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.171498 Apr 05 13:49:30.610098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 410/840] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:30 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:30.632160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:30.639561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0cdc5e32-f047-4960-8059-ddaa9c19e7ef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.320877 Apr 05 13:49:30.640814 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 431/841] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:30 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:30.983328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:30.984001 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:30.992447 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.993017 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:30.993937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:30.994480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.131991 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.139722 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.141212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.142366 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-49880e28-b7d2-4fd8-bc13-73b0b311cbf3 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1730 microversion: 2.20 time: 0.162914 Apr 05 13:49:31.142930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 411/842] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:30 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:31.436628 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:31.437255 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:31.444870 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.445394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.446256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.446764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.589835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.599160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-02c6ac31-7c70-4edc-bcf0-80d7cf4e949f tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1519 microversion: 2.1 time: 0.166657 Apr 05 13:49:31.608618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 432/843] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:31 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:31.630615 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:31.631776 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:31.640453 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.641177 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.642674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.643267 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.651877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e672018-0182-4460-8378-999578b50317", "name": "network-vif-plugged", "status": "completed", "tag": "cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94"}, {"server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "name": "network-vif-unplugged", "status": "completed", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:31.672815 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.673480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.689316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] Creating event network-vif-plugged:cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94 for instance 4e672018-0182-4460-8378-999578b50317 on hv-cinder-83587 Apr 05 13:49:31.690102 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.compute.server_external_events [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] Unable to find a host for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6. Dropping event network-vif-unplugged {{(pid=123520) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 05 13:49:31.697722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-2225feeb-6dae-40bd-8142-82d3980c925f req-3042dea9-e943-4900-be17-9a62abdb0f5b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.049646 Apr 05 13:49:31.699412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 433/844] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 05 13:49:31.708608 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:31.709503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:31.718847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.719306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.720138 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:31.720575 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:31.839421 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.849810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bb214f4a-a147-4b6f-b632-94e8b5cb5a0a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.226933 Apr 05 13:49:31.850752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 412/845] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:31 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:31.877654 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:31.885156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1b927e5b-1ff7-4f32-9dc2-6686a510ac9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.184379 Apr 05 13:49:31.885662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 434/846] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:31 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:32.162067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:32.162608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:32.169021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.169478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.170251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.170709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.298291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:32.306946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:32.308478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:32.309631 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b3f18106-dcdb-4f6b-9cf4-754a3a48b65f tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1717 microversion: 2.20 time: 0.152264 Apr 05 13:49:32.310199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 413/847] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:49:32 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:49:32.618107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:32.618709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:32.626290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.626734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.627545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.627987 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.813839 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:32.822093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a160eebd-e585-4164-a876-397b9aab4eb0 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1519 microversion: 2.1 time: 0.208231 Apr 05 13:49:32.822672 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 435/848] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:32 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:32.867147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:32.867779 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:32.874033 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.874493 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.875268 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.875739 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.901969 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:32.902574 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:32.908448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.908896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:32.910175 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:32.910696 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:33.015123 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:33.022958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0506414d-4b0f-4047-8e98-98d7837c5cf7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.160331 Apr 05 13:49:33.023657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 414/849] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:32 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:33.108149 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:33.116218 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5603fbe7-0953-4f10-a601-2c9a669922c5 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.218087 Apr 05 13:49:33.117125 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 436/850] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:32 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:33.840095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:33.841291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:33.847784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:33.848425 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:33.849206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:33.849804 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:33.991223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:33.998879 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e82120a7-383b-49ce-833b-30fa3386aec8 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.162609 Apr 05 13:49:33.999456 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 415/851] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:33 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:34.040225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:34.040845 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:34.047055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:34.047525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:34.048306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:34.048746 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:34.133812 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:34.134368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:34.140083 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:34.140542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:34.141319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:34.141758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:34.211017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:34.218410 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2eec7b06-7105-4701-a7da-89ae5cf6bcbb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.182077 Apr 05 13:49:34.219065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 437/852] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:34 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:34.274776 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:34.282181 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-707b13ae-5dd6-4805-a42c-68c7cde1beb8 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1265 microversion: 2.1 time: 0.152328 Apr 05 13:49:34.282746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 416/853] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:34 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:35.016209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:35.016818 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:35.023062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.023526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.024301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.024730 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.163233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:35.171507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ffb43230-2487-4ed2-a584-3b1fe72de905 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.159204 Apr 05 13:49:35.172075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 438/854] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:35 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:35.235551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:35.236161 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:35.243624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.244073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.244832 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.245262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.298142 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:35.298758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:35.306295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.306751 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.307560 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.308003 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.382201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:35.389903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4090b8c5-e7d1-4049-96db-937e64141d46 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.158102 Apr 05 13:49:35.390469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 417/855] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:35 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:35.444206 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:35.452526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8acaa56f-3260-46d5-817a-d2a09384572d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1451 microversion: 2.1 time: 0.158176 Apr 05 13:49:35.453115 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 439/856] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:35 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:35.469039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:35.469910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:35.477063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.477601 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.478390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.478846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.571396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-73ee4b1e-d2dd-4945-bbde-b2008256c141 req-f95b69c5-8f86-4ebd-bec4-b25abdd4b314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e769137-37bf-4cb2-b020-d664054c61b0", "name": "network-vif-plugged", "status": "completed", "tag": "68b098ba-9acc-40b2-a9c1-81e4551c96cc"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:35.580191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-73ee4b1e-d2dd-4945-bbde-b2008256c141 req-f95b69c5-8f86-4ebd-bec4-b25abdd4b314 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:35.580930 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-73ee4b1e-d2dd-4945-bbde-b2008256c141 req-f95b69c5-8f86-4ebd-bec4-b25abdd4b314 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:35.593294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-73ee4b1e-d2dd-4945-bbde-b2008256c141 req-f95b69c5-8f86-4ebd-bec4-b25abdd4b314 service nova] Creating event network-vif-plugged:68b098ba-9acc-40b2-a9c1-81e4551c96cc for instance 9e769137-37bf-4cb2-b020-d664054c61b0 on hv-cinder-83587 Apr 05 13:49:35.599015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-73ee4b1e-d2dd-4945-bbde-b2008256c141 req-f95b69c5-8f86-4ebd-bec4-b25abdd4b314 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031242 Apr 05 13:49:35.599963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 440/857] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:35.623362 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:35.630915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9aad0f3f-01f8-45f9-a9d9-3c85b2d0080f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1451 microversion: 2.1 time: 0.165794 Apr 05 13:49:35.641014 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 418/858] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:35 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:36.190147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:36.191764 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:36.198079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:36.198529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:36.199297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:36.199848 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:36.341045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:36.349451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a7e61b2a-85fa-41db-bf4e-86b9d9f704d7 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.163998 Apr 05 13:49:36.350437 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 441/859] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:36 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:36.406037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:36.406624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:36.413751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:36.414191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:36.414982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:36.415414 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:36.671700 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:36.678924 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ee792146-9a01-4d9c-bc7e-22c343dde402 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1361 microversion: 2.1 time: 0.276699 Apr 05 13:49:36.688383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 419/860] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:36 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:37.367278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:37.367927 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:37.374162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.374610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.375373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.375835 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.516952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:37.524579 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ca19fe74-a6e8-417f-ac5f-a313e38f2e77 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.161262 Apr 05 13:49:37.525167 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 442/861] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:37 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:37.697901 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:37.698273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:37.704943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.705395 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.706567 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.707102 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.813275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-bb1ce6fb-b543-4d7c-938e-fe1f08939fb4 req-e1b5480e-f23c-4764-a967-1988c5c0e39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e672018-0182-4460-8378-999578b50317", "tag": "cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:37.822173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-bb1ce6fb-b543-4d7c-938e-fe1f08939fb4 req-e1b5480e-f23c-4764-a967-1988c5c0e39f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.822801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-bb1ce6fb-b543-4d7c-938e-fe1f08939fb4 req-e1b5480e-f23c-4764-a967-1988c5c0e39f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.834545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-bb1ce6fb-b543-4d7c-938e-fe1f08939fb4 req-e1b5480e-f23c-4764-a967-1988c5c0e39f service nova] Creating event network-changed:cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94 for instance 4e672018-0182-4460-8378-999578b50317 on hv-cinder-83587 Apr 05 13:49:37.839905 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-bb1ce6fb-b543-4d7c-938e-fe1f08939fb4 req-e1b5480e-f23c-4764-a967-1988c5c0e39f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093518 Apr 05 13:49:37.840821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 443/862] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:37.883032 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:37.890458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3773913f-d1db-4fbd-bb7b-61fbdbb98a6d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1546 microversion: 2.1 time: 0.198234 Apr 05 13:49:37.899138 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 420/863] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:37 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:37.908053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:37.908642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:37.919718 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.920451 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:37.923855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:37.923855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:38.060418 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fba8d4a6-5cef-4570-abf7-2c9367572030 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156806 Apr 05 13:49:38.061283 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 444/864] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:49:37 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:38.541699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:38.542316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:38.548445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:38.549026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:38.550684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:38.551291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:38.704466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:38.713682 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-364684b2-35e6-498c-a6b0-8a05826f9507 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.175638 Apr 05 13:49:38.723576 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 421/865] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:38 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:39.612662 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-38eb4fda-0ad4-4c87-bb7b-911254f7a5f2 req-e33543e1-8ae2-4d3a-9c11-fa04715626be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e769137-37bf-4cb2-b020-d664054c61b0", "tag": "68b098ba-9acc-40b2-a9c1-81e4551c96cc"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:39.620676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-38eb4fda-0ad4-4c87-bb7b-911254f7a5f2 req-e33543e1-8ae2-4d3a-9c11-fa04715626be service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:39.621111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-38eb4fda-0ad4-4c87-bb7b-911254f7a5f2 req-e33543e1-8ae2-4d3a-9c11-fa04715626be service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:39.632634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-38eb4fda-0ad4-4c87-bb7b-911254f7a5f2 req-e33543e1-8ae2-4d3a-9c11-fa04715626be service nova] Creating event network-changed:68b098ba-9acc-40b2-a9c1-81e4551c96cc for instance 9e769137-37bf-4cb2-b020-d664054c61b0 on hv-cinder-83587 Apr 05 13:49:39.637459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-38eb4fda-0ad4-4c87-bb7b-911254f7a5f2 req-e33543e1-8ae2-4d3a-9c11-fa04715626be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029423 Apr 05 13:49:39.638052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 445/866] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:39.731607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:39.732417 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:39.739448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:39.740145 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:39.740927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:39.741367 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:39.881329 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:39.888691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3b2eea51-f59b-4af8-b917-f8313308e97b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.160932 Apr 05 13:49:39.889265 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 422/867] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:39 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:40.907160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:40.908025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:40.914568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:40.915013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:40.915792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:40.916225 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:41.056077 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:41.063351 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cf392a93-7c16-4506-8b9b-4925fb525e9c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.160931 Apr 05 13:49:41.064042 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 446/868] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:40 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:49:42.080306 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:42.080977 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:42.088105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:42.088563 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:42.089386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:42.089829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:42.222163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:42.229792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-71bca004-06e7-4a31-8f8b-d6d70c04556b tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.153350 Apr 05 13:49:42.230368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 423/869] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:42 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:42.294194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:42.294746 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:42.302074 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:42.302553 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:42.303336 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:42.303808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:42.326479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3549a987-1d4a-4989-a864-18c52ceffaa2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/ips" status: 200 len: 151 microversion: 2.1 time: 0.036125 Apr 05 13:49:42.327057 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 447/870] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:49:42 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:43.247965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:43.248574 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:43.255586 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:43.256032 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:43.256793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:43.257225 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:43.394563 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:43.401786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b8a4827-67cb-4780-be18-99bc9c6a090c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.157619 Apr 05 13:49:43.402365 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 424/871] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:43 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:43.593993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-6c6219bb-5bcb-4ea8-8cfe-99a3d1844698 req-cf8fd6f2-60ed-43cd-83d1-54c081484ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "name": "network-vif-plugged", "status": "completed", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:43.605264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6c6219bb-5bcb-4ea8-8cfe-99a3d1844698 req-cf8fd6f2-60ed-43cd-83d1-54c081484ff4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:43.605605 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6c6219bb-5bcb-4ea8-8cfe-99a3d1844698 req-cf8fd6f2-60ed-43cd-83d1-54c081484ff4 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:43.619030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-6c6219bb-5bcb-4ea8-8cfe-99a3d1844698 req-cf8fd6f2-60ed-43cd-83d1-54c081484ff4 service nova] Creating event network-vif-plugged:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:49:43.624064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-6c6219bb-5bcb-4ea8-8cfe-99a3d1844698 req-cf8fd6f2-60ed-43cd-83d1-54c081484ff4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033858 Apr 05 13:49:43.624974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 448/872] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:43.640292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ecb8fe8-3a1d-42e8-9a90-8052ea2eca07"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:43.641454 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:43.648047 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:43.648494 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:43.649317 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:43.649733 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:43.919976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c7ffde28-b227-42df-b669-36e7e160abbc tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "POST /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283378 Apr 05 13:49:43.920682 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 425/873] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:49:43 2022] POST /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:44.419686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:44.420293 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:44.426387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:44.426841 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:44.427695 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:44.428131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:44.567916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:44.575457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-59342d67-0043-4005-b314-c16ddc503d93 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1575 microversion: 2.1 time: 0.160114 Apr 05 13:49:44.576055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 449/874] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:44 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:45.593718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:45.594429 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:45.601060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:45.601512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:45.602315 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:45.602753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:45.738828 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:45.746124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-360705fb-7b45-41ba-9797-4efc2eceb8cd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1562 microversion: 2.1 time: 0.157110 Apr 05 13:49:45.746691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 426/875] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:45 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:51.490325 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:51.490846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:51.497343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:51.497801 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:51.498547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:51.498979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:51.575799 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lazy-loading 'services' on Instance uuid 458b08fb-48ac-4bec-8f2a-a900c7499671 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:49:51.646300 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e8ea6ad1-e59d-4c5c-ba43-c66868f79143 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments/7ecb8fe8-3a1d-42e8-9a90-8052ea2eca07" status: 202 len: 0 microversion: 2.1 time: 0.160363 Apr 05 13:49:51.646883 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 450/876] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:49:51 2022] DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments/7ecb8fe8-3a1d-42e8-9a90-8052ea2eca07 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:49:51.655116 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:51.656113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:51.663915 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:51.664419 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:51.665195 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:51.665632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:51.694559 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec0b5073-e461-434e-931b-21cbdfb24a95 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Apr 05 13:49:51.695118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 427/877] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:49:51 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:52.708299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:52.709214 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:52.715348 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.715825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:52.716589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.717023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:52.745871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-da1fa3e0-9c30-4873-87b1-1e1d88b900b2 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043421 Apr 05 13:49:52.746422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 451/878] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:49:52 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:49:52.816937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:52.817859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:52.824370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.824819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:52.825667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.826124 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:52.849760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:49:52.923772 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3d4e2f76-84a5-474c-b466-fc125d0f8194 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 204 len: 0 microversion: 2.1 time: 0.112135 Apr 05 13:49:52.925242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 428/879] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:52 2022] DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 13:49:52.933247 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:52.933954 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:52.939777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.940808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:52.941605 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:52.942160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:53.077892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:53.085571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2a1f41d3-1459-419e-a9ad-98be21a65894 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1682 microversion: 2.1 time: 0.156192 Apr 05 13:49:53.086143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 452/880] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:52 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:54.103230 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:54.103871 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:54.110041 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:54.110489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:54.111247 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:54.111713 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:54.240967 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:54.248220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-45eb8a3f-c3f0-4ebc-9e34-32a97525cd13 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1682 microversion: 2.1 time: 0.149523 Apr 05 13:49:54.248784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 429/881] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:54 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:55.265991 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:55.266714 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:55.273446 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:55.273901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:55.274653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:55.275170 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:55.476932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5577d987826f4424a91c12293f2e38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e332af07b8443bb5fe05decbfab0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:49:55.484110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-62328092-9cf6-4b60-9c60-aea58943e5c1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 200 len: 1682 microversion: 2.1 time: 0.222179 Apr 05 13:49:55.484673 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 453/882] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:55 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:49:55.790089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-f7d41de3-4f8f-490c-be3f-ad27eb4e2e5f req-dacb2a5b-1f47-4f1e-9b13-8a3da0804ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458b08fb-48ac-4bec-8f2a-a900c7499671", "name": "network-vif-deleted", "tag": "5ce43029-8922-4702-b1d8-44ae015a94ae"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:49:55.804408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f7d41de3-4f8f-490c-be3f-ad27eb4e2e5f req-dacb2a5b-1f47-4f1e-9b13-8a3da0804ba5 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:55.804945 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f7d41de3-4f8f-490c-be3f-ad27eb4e2e5f req-dacb2a5b-1f47-4f1e-9b13-8a3da0804ba5 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:55.816028 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-f7d41de3-4f8f-490c-be3f-ad27eb4e2e5f req-dacb2a5b-1f47-4f1e-9b13-8a3da0804ba5 service nova] Creating event network-vif-deleted:5ce43029-8922-4702-b1d8-44ae015a94ae for instance 458b08fb-48ac-4bec-8f2a-a900c7499671 on hv-cinder-83587 Apr 05 13:49:55.821226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-f7d41de3-4f8f-490c-be3f-ad27eb4e2e5f req-dacb2a5b-1f47-4f1e-9b13-8a3da0804ba5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Apr 05 13:49:55.822180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 430/883] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:49:56.500574 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:56.501176 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:56.508195 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:56.508629 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:56.509399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:56.509829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:56.524156 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. Apr 05 13:49:56.524953 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:56.525783 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-40ab6f1d-ef35-411c-aca9-ebdf86162119 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 404 len: 111 microversion: 2.1 time: 0.029175 Apr 05 13:49:56.526324 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 454/884] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:56 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:56.536982 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-904fa337-f412-4f00-ad1c-a375a6f299a1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '.version_select at 0x7f9bfd934160>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:56.555141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-904fa337-f412-4f00-ad1c-a375a6f299a1 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468780016" status: 202 len: 0 microversion: 2.1 time: 0.023979 Apr 05 13:49:56.559072 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 431/885] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Apr 5 13:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468780016 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:49:58.318020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:58.318569 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:58.325960 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:58.326500 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:58.327292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:58.327772 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:58.341638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. Apr 05 13:49:58.342234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:58.343064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1de59bdf-a9f2-4864-a315-c094d48519f5 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 404 len: 111 microversion: 2.1 time: 0.029505 Apr 05 13:49:58.343625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 455/886] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:58 2022] DELETE /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:58.352320 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:58.353130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 458b08fb-48ac-4bec-8f2a-a900c7499671] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:58.359598 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:58.360062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:58.360835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:58.361274 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:58.374258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. Apr 05 13:49:58.374844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 458b08fb-48ac-4bec-8f2a-a900c7499671 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:58.375714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-98edf674-0bc3-4ee7-a50b-5f5b853a1101 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671" status: 404 len: 111 microversion: 2.1 time: 0.027426 Apr 05 13:49:58.376261 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 432/887] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:58 2022] GET /compute/v2.1/servers/458b08fb-48ac-4bec-8f2a-a900c7499671 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:49:59.509240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:59.509733 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:59.515948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.516400 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.517163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.517601 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.530667 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. Apr 05 13:49:59.531246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:59.532111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0a7698e2-9e1d-42fd-af64-66628b58dc1c tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 404 len: 111 microversion: 2.1 time: 0.026702 Apr 05 13:49:59.532637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 456/888] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:59 2022] DELETE /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:59.541037 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:59.541651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 1973be0b-72c3-40eb-8bf6-3ebb28381096] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:59.547856 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.548319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.549774 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.550426 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.563277 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. Apr 05 13:49:59.563882 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 1973be0b-72c3-40eb-8bf6-3ebb28381096 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:59.564826 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cb358080-5078-4416-8ed1-8e4c7714d41d tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096" status: 404 len: 111 microversion: 2.1 time: 0.027511 Apr 05 13:49:59.565639 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 433/889] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:59 2022] GET /compute/v2.1/servers/1973be0b-72c3-40eb-8bf6-3ebb28381096 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:59.573387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:59.573887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:59.579625 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.580080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.581825 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.582273 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.595265 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. Apr 05 13:49:59.596503 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:59.597665 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-352ea8e1-2a67-4682-8450-4ffd8720a376 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 404 len: 111 microversion: 2.1 time: 0.028068 Apr 05 13:49:59.598200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 457/890] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:49:59 2022] DELETE /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:49:59.606258 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:49:59.607044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:49:59.614034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.614484 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.615242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:49:59.615835 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:49:59.628753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. Apr 05 13:49:59.629323 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:49:59.630127 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ade1ddba-cdbb-4dbc-87e7-515c17379717 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347" status: 404 len: 111 microversion: 2.1 time: 0.027715 Apr 05 13:49:59.630936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 434/891] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:49:59 2022] GET /compute/v2.1/servers/50ea9bc3-2ebc-4c62-a4ee-10e9b5cce347 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:50:00.761057 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:00.761549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:00.768078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:00.768558 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:00.769315 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:00.769748 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:00.782420 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. Apr 05 13:50:00.782999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:00.784506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b3c93490-47b4-4539-87e3-87332d4ba2c0 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 404 len: 111 microversion: 2.1 time: 0.027380 Apr 05 13:50:00.785021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 458/892] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:50:00 2022] DELETE /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:50:00.792817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:00.793427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] [instance: 3dcf398b-babb-4847-a7f6-19219fca641e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:00.800340 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:00.800789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:00.801555 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:00.801992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:00.814802 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] HTTP exception thrown: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. Apr 05 13:50:00.815379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] Returning 404 to user: Instance 3dcf398b-babb-4847-a7f6-19219fca641e could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:00.816217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-848552b9-7f0b-44b5-a750-0ad17348f520 tempest-AttachVolumeNegativeTest-2127350906 tempest-AttachVolumeNegativeTest-2127350906-project] 10.222.0.59 "GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e" status: 404 len: 111 microversion: 2.1 time: 0.027306 Apr 05 13:50:00.816739 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 435/893] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:00 2022] GET /compute/v2.1/servers/3dcf398b-babb-4847-a7f6-19219fca641e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:50:13.782602 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:13.784282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:13.790551 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:13.791137 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:13.792094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:13.792531 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:13.821642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-99884408-f124-41a0-bd4d-e189a0b72dfc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043001 Apr 05 13:50:13.822200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 459/894] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Apr 5 13:50:13 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:13.884914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:13.885466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:13.891859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:13.892928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:13.894013 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:13.894521 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:13.920444 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:50:13.996460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-86fbea17-13ce-474a-bfff-3d872afd45b2 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 204 len: 0 microversion: 2.20 time: 0.114927 Apr 05 13:50:13.997087 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 436/895] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Apr 5 13:50:13 2022] DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 13:50:14.007035 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:14.007762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:14.013570 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:14.014021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:14.014810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:14.015249 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:14.152970 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:14.161809 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:14.163289 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:14.164474 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a416c7c1-098d-43b5-a93d-3a7060da09d7 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.161435 Apr 05 13:50:14.165028 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 460/896] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:14 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 13:50:15.183573 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:15.184195 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:15.190440 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:15.190894 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:15.191699 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:15.192140 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:15.335855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:15.343695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:15.345217 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:15.347382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c940adb3-ccda-4dce-a7ae-c500bb1785e1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1723 microversion: 2.20 time: 0.168175 Apr 05 13:50:15.347969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 437/897] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:15 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:50:16.366431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:16.366982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:16.373131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:16.373586 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:16.374352 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:16.374789 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:16.450617 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:16.459258 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:16.460779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebc660250144556aedb16590cdcce0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6e9d5de52b4741bb5efe2a286e8e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:16.461961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-87001579-8631-4b3e-865f-c31679eabda9 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 200 len: 1655 microversion: 2.20 time: 0.099665 Apr 05 13:50:16.462517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 461/898] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:16 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 1655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 13:50:16.738213 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-bb9d15f9-59d7-4186-9978-86fecd62b18d req-b5cccd50-61e1-4be4-abfd-90074b2e573a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa08f903-e829-4655-b53f-46c9db758d18", "name": "network-vif-deleted", "tag": "074d013b-9ce4-47d8-b88a-047e91d0ee78"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:16.753831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bb9d15f9-59d7-4186-9978-86fecd62b18d req-b5cccd50-61e1-4be4-abfd-90074b2e573a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:16.754391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bb9d15f9-59d7-4186-9978-86fecd62b18d req-b5cccd50-61e1-4be4-abfd-90074b2e573a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:16.773474 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-bb9d15f9-59d7-4186-9978-86fecd62b18d req-b5cccd50-61e1-4be4-abfd-90074b2e573a service nova] Creating event network-vif-deleted:074d013b-9ce4-47d8-b88a-047e91d0ee78 for instance fa08f903-e829-4655-b53f-46c9db758d18 on hv-cinder-83587 Apr 05 13:50:16.782381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-bb9d15f9-59d7-4186-9978-86fecd62b18d req-b5cccd50-61e1-4be4-abfd-90074b2e573a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047297 Apr 05 13:50:16.783751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 438/899] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:17.483344 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:17.484030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:17.492121 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:17.492573 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:17.493349 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:17.493781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:17.508520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. Apr 05 13:50:17.509114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:17.510062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b7910358-4004-4183-aa6f-43a8e06c242c tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 404 len: 111 microversion: 2.20 time: 0.031280 Apr 05 13:50:17.510808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 462/900] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:17 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:50:17.520115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-061637b8-0bf2-49f1-b1ee-d2dbb6f4aed1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '.version_select at 0x7f9bfd72d430>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:17.541639 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-061637b8-0bf2-49f1-b1ee-d2dbb6f4aed1 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388907273" status: 204 len: 0 microversion: 2.20 time: 0.026038 Apr 05 13:50:17.542781 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 439/901] 10.222.0.59 () {60 vars in 1258 bytes} [Tue Apr 5 13:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388907273 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 13:50:19.663363 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:19.663894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:19.669952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:19.670480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:19.671332 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:19.671979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:19.687947 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. Apr 05 13:50:19.688544 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:19.689978 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e31956bf-2cbc-4b41-aec1-0d4c57b9eda4 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 404 len: 111 microversion: 2.20 time: 0.030504 Apr 05 13:50:19.690538 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 463/902] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Apr 5 13:50:19 2022] DELETE /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:50:19.698957 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:19.699815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: fa08f903-e829-4655-b53f-46c9db758d18] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:19.706415 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:19.706961 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:19.707833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:19.708340 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:19.721928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. Apr 05 13:50:19.722526 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance fa08f903-e829-4655-b53f-46c9db758d18 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:19.723559 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bbab256b-31d1-49f6-9434-678e766980bc tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18" status: 404 len: 111 microversion: 2.20 time: 0.028873 Apr 05 13:50:19.724109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 440/903] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:19 2022] GET /compute/v2.1/servers/fa08f903-e829-4655-b53f-46c9db758d18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:50:20.866314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:20.867157 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:20.874767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:20.875227 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:20.876027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:20.876512 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:20.890298 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. Apr 05 13:50:20.890889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:20.891758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7e031e2d-2868-47f7-941d-da7b6e710c81 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 404 len: 111 microversion: 2.20 time: 0.030489 Apr 05 13:50:20.893037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 464/904] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Apr 5 13:50:20 2022] DELETE /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:50:20.900948 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:20.901560 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] [instance: e37a50af-47fc-4de4-a209-8116bed7038d] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:20.908230 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:20.908697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:20.909513 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:20.909947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:20.923592 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] HTTP exception thrown: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. Apr 05 13:50:20.924318 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] Returning 404 to user: Instance e37a50af-47fc-4de4-a209-8116bed7038d could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:20.925205 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-37a5ab6a-a9af-4cd7-8523-86f872ddc233 tempest-AttachVolumeShelveTestJSON-789032512 tempest-AttachVolumeShelveTestJSON-789032512-project] 10.222.0.59 "GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d" status: 404 len: 111 microversion: 2.20 time: 0.028064 Apr 05 13:50:20.925696 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 441/905] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Apr 5 13:50:20 2022] GET /compute/v2.1/servers/e37a50af-47fc-4de4-a209-8116bed7038d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 13:50:23.136033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:23.136537 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:23.143397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:23.148191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:23.156228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:23.156952 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:23.186099 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1b2ce665-e421-4000-adf9-6ba0808be703 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/ips" status: 200 len: 145 microversion: 2.1 time: 0.054271 Apr 05 13:50:23.187062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 465/906] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:50:23 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:25.570497 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09edaa2e-f426-4b69-b4b4-023cf0452087"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:25.571587 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:25.577338 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:25.577799 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:25.578584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:25.579024 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:25.816469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2b0ba63c-7183-4d14-ab03-b8aa3ef5705e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249904 Apr 05 13:50:25.817186 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 442/907] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:50:25 2022] POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:26.008064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db4fe7f7-1467-40b5-a7d6-ef3a9570d965 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Action: 'create', calling method: .version_select at 0x7f9bfd917160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1608436207", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:26.097911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1721809252", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "networks": [{"uuid": "9c68b7e7-b165-40cb-9f4c-5738dd772515"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:26.152126 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] validate_networks() for [('9c68b7e7-b165-40cb-9f4c-5738dd772515', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:50:26.342739 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-db4fe7f7-1467-40b5-a7d6-ef3a9570d965 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.463964 Apr 05 13:50:26.343526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 466/908] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Apr 5 13:50:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 466 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 13:50:26.355482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b9b3d823-98e2-4624-92a4-2b8e4e91f6b7 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd6dff70>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:26.408727 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b9b3d823-98e2-4624-92a4-2b8e4e91f6b7 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 200 len: 353 microversion: 2.1 time: 0.056973 Apr 05 13:50:26.409305 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 467/909] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:50:26 2022] GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:50:26.566055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:50:26.566477 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:50:26.566975 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:50:26.567380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:50:26.567867 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:50:26.576431 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:26.576992 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:26.577817 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:26.578288 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:26.596292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Getting quotas for project e7a9bd0d7b424d6184c5a0780ae39a79. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:50:26.600913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Getting quotas for user f916bfa231f74b41958194415fa0b13e and project e7a9bd0d7b424d6184c5a0780ae39a79. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:50:26.612036 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:50:26.614405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:50:26.656902 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4519df3f-418c-490f-b095-750acc969c39 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563448 Apr 05 13:50:26.658199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 443/910] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 13:50:26.668008 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7d54d31e-dde8-4377-b19e-ca55e6399a6b tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:26.668633 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7d54d31e-dde8-4377-b19e-ca55e6399a6b tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:26.725264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7d54d31e-dde8-4377-b19e-ca55e6399a6b tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:26.732070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7d54d31e-dde8-4377-b19e-ca55e6399a6b tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1219 microversion: 2.1 time: 0.067829 Apr 05 13:50:26.732644 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 468/911] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:26 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:50:27.421175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fb199120-10f9-4cf4-8a94-d1787b5f4120 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd7ab430>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:27.467122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fb199120-10f9-4cf4-8a94-d1787b5f4120 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 200 len: 354 microversion: 2.1 time: 0.050291 Apr 05 13:50:27.467721 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 444/912] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:50:27 2022] GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:27.480232 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-995b4799-cb29-4d45-8ad3-6f1d3cda597c tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd99a160>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:27.525895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-995b4799-cb29-4d45-8ad3-6f1d3cda597c tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 200 len: 354 microversion: 2.1 time: 0.049340 Apr 05 13:50:27.526746 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 469/913] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:50:27 2022] GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:27.543016 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3e4b40e3-da60-4911-adc1-617a863a1c27 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd7de430>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:27.606755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3e4b40e3-da60-4911-adc1-617a863a1c27 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 202 len: 0 microversion: 2.1 time: 0.067418 Apr 05 13:50:27.608460 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 445/914] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:50:27 2022] DELETE /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:50:27.616944 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3084706b-749c-4cdd-85e3-6685b5100203 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd9aa940>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:27.670642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3084706b-749c-4cdd-85e3-6685b5100203 tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 200 len: 353 microversion: 2.1 time: 0.057703 Apr 05 13:50:27.675800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 470/915] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:50:27 2022] GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:27.748464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:27.749077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:27.757118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:27.757523 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:27.758396 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:27.758832 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:27.824462 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:27.833322 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-12e6a2e7-1da9-4526-9a70-a652e47298f9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1277 microversion: 2.1 time: 0.088610 Apr 05 13:50:27.833911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 446/916] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:27 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:28.682890 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-58372f04-6092-4f59-9852-30eed6442cda tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Calling method '.version_select at 0x7f9bfd80c310>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:28.713373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-58372f04-6092-4f59-9852-30eed6442cda tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] HTTP exception thrown: Volume eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 could not be found. Apr 05 13:50:28.713988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-58372f04-6092-4f59-9852-30eed6442cda tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] Returning 404 to user: Volume eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:50:28.714828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-58372f04-6092-4f59-9852-30eed6442cda tempest-VolumesGetTestJSON-1196378882 tempest-VolumesGetTestJSON-1196378882-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3" status: 404 len: 109 microversion: 2.1 time: 0.036560 Apr 05 13:50:28.715411 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 471/917] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Apr 5 13:50:28 2022] GET /compute/v2.1/os-volumes/eb6c72e8-3b7d-4bd0-b941-5bf4e0fa85f3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:50:28.850346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:28.850955 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:28.857291 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:28.857970 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:28.858741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:28.859356 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:28.925316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-2a2d55ce-accf-4573-965a-14fa24860e3b req-14728fae-9d3d-4f87-83e9-3e5ddf3c0f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1641e5e1-6e73-4844-a305-acaf94411d60", "tag": "54b6925e-7700-4979-a669-01caca6018a0"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:28.936007 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2a2d55ce-accf-4573-965a-14fa24860e3b req-14728fae-9d3d-4f87-83e9-3e5ddf3c0f74 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:28.936453 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2a2d55ce-accf-4573-965a-14fa24860e3b req-14728fae-9d3d-4f87-83e9-3e5ddf3c0f74 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:28.950200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-2a2d55ce-accf-4573-965a-14fa24860e3b req-14728fae-9d3d-4f87-83e9-3e5ddf3c0f74 service nova] Creating event network-changed:54b6925e-7700-4979-a669-01caca6018a0 for instance 1641e5e1-6e73-4844-a305-acaf94411d60 on hv-cinder-83587 Apr 05 13:50:28.956232 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-2a2d55ce-accf-4573-965a-14fa24860e3b req-14728fae-9d3d-4f87-83e9-3e5ddf3c0f74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037615 Apr 05 13:50:28.957484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 472/918] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:50:29.028625 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:29.042275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef1e3d50-74e3-4739-b793-b30b305f846f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.195865 Apr 05 13:50:29.043201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 447/919] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:28 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:30.059423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:30.060145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:30.067234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:30.067779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:30.068482 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:30.068916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:30.207658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:30.214948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-46134cf0-88d8-4493-baba-d21c7655687e tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.159766 Apr 05 13:50:30.215535 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 473/920] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:30 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:31.231838 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:31.232455 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:31.239813 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:31.240266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:31.241044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:31.241485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:31.382652 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:31.389985 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-240026e9-a186-4e8b-8d8e-1b4bfc477fc1 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.162338 Apr 05 13:50:31.390556 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 448/921] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:31 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:50:32.407642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:32.408340 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:32.414236 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:32.414679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:32.415440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:32.415904 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:32.552759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:32.560309 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-13c6df4b-1d40-471a-a54c-6f298b5ae0ea tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.156927 Apr 05 13:50:32.561238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 474/922] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:32 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:33.366034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-98e54d1a-a7f5-4c6a-b540-ce8cc3a071f3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:33.372325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98e54d1a-a7f5-4c6a-b540-ce8cc3a071f3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:33.372778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98e54d1a-a7f5-4c6a-b540-ce8cc3a071f3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:33.434977 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-98e54d1a-a7f5-4c6a-b540-ce8cc3a071f3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Going to try to stop instance {{(pid=123519) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 13:50:33.478747 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-98e54d1a-a7f5-4c6a-b540-ce8cc3a071f3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action" status: 202 len: 0 microversion: 2.1 time: 0.116392 Apr 05 13:50:33.479356 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 449/923] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:50:33 2022] POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:50:33.487973 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:33.488585 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:33.495847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:33.496636 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:33.497062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:33.497522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:33.578284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:33.579974 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:33.587391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:33.588082 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:33.589048 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:33.590344 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:33.655755 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:33.664414 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ebc73fa-727d-440c-afef-c17a427c6688 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.180726 Apr 05 13:50:33.668198 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 475/924] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:33 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:33.752279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:33.760600 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4ac9fbc7-27ea-4537-9f47-b10553ad9852 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.186761 Apr 05 13:50:33.761176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 450/925] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:33 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:34.684242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:34.685126 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:34.692741 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:34.693183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:34.693941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:34.694371 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:34.779020 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:34.780199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:34.787469 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:34.788880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:34.789986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:34.790661 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:34.859974 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:34.868896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6be32548-fd7d-4f89-87aa-7a92a8ee553e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.188475 Apr 05 13:50:34.869561 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 476/926] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:34 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:34.949478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:34.956714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dd7bae65-76e6-4bf3-8543-8c8f47ac98fe tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.182802 Apr 05 13:50:34.957287 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 451/927] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:34 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:50:35.734522 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-4411df20-303f-42cf-be19-bea751bec2a6 req-446a858b-d047-4541-bb96-1eddde498a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1641e5e1-6e73-4844-a305-acaf94411d60", "name": "network-vif-plugged", "status": "completed", "tag": "54b6925e-7700-4979-a669-01caca6018a0"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:35.742900 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4411df20-303f-42cf-be19-bea751bec2a6 req-446a858b-d047-4541-bb96-1eddde498a34 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:35.743343 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4411df20-303f-42cf-be19-bea751bec2a6 req-446a858b-d047-4541-bb96-1eddde498a34 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:35.754590 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-4411df20-303f-42cf-be19-bea751bec2a6 req-446a858b-d047-4541-bb96-1eddde498a34 service nova] Creating event network-vif-plugged:54b6925e-7700-4979-a669-01caca6018a0 for instance 1641e5e1-6e73-4844-a305-acaf94411d60 on hv-cinder-83587 Apr 05 13:50:35.759308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-4411df20-303f-42cf-be19-bea751bec2a6 req-446a858b-d047-4541-bb96-1eddde498a34 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028483 Apr 05 13:50:35.759926 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 477/928] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:50:35.886930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:35.887693 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:35.895946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:35.896433 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:35.897214 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:35.897775 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:35.979134 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:35.980224 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:35.988657 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:35.989699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:35.991266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:35.991937 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:36.052600 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:36.060862 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-068d571f-fc45-4107-8988-dd335b65ee7a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.177711 Apr 05 13:50:36.061514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 452/929] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:35 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:50:36.145015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:36.152519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-42e868c7-cbec-42db-909c-49a4c0bb9b1a tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1319 microversion: 2.1 time: 0.181643 Apr 05 13:50:36.153090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 478/930] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:35 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:37.078227 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:37.079368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:37.086476 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:37.086933 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:37.087755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:37.088191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:37.170091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:37.170777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:37.177290 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:37.177945 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:37.178878 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:37.179484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:37.242997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:37.250753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e965ad05-c543-4470-835d-147ce3438317 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.176367 Apr 05 13:50:37.251448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 453/931] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:37 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:37.338396 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:37.346337 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-69a4d67f-6c1a-415f-a69d-3916bb9bd420 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1508 microversion: 2.1 time: 0.180039 Apr 05 13:50:37.347234 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 479/932] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:37 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:38.268375 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:38.268996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:38.275197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:38.275697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:38.276494 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:38.276939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:38.574098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:38.583130 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e8ff3575-6d4c-403e-8d08-b5ba336511d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.318440 Apr 05 13:50:38.583824 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 454/933] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:38 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:39.601280 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:39.601829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:39.608233 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:39.608647 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:39.609464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:39.610457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:39.754053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:39.761887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dce8e35f-a4e6-4ef1-b05a-4d2108ff12d5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.164888 Apr 05 13:50:39.762454 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 480/934] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:39 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:40.779185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:40.779838 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:40.786361 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:40.786820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:40.787624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:40.788065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:40.939612 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:40.947426 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3b1979b1-1def-442b-94fc-2c88b40d3a42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.171999 Apr 05 13:50:40.948012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 455/935] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:40 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:41.965183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:41.966017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:41.972767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:41.973286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:41.974160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:41.974980 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:42.121110 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:42.130030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0a5eba05-c397-4a0a-9807-7790ca4bca70 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.169029 Apr 05 13:50:42.137998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 481/936] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:41 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:43.148118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:43.148727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:43.154963 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:43.155422 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:43.156226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:43.156771 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:43.294303 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:43.303527 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a8079103-f7a5-4b2e-be40-66e91df1d29e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.159248 Apr 05 13:50:43.304228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 456/937] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:43 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:44.321681 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:44.322294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:44.329441 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:44.329913 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:44.330696 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:44.331134 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:44.487941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:44.495701 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-818e7299-4a28-4e46-adf7-27dbd07ad6c6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.177864 Apr 05 13:50:44.499948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 482/938] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:44 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:45.513251 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:45.513864 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:45.521108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:45.521569 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:45.524400 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:45.524859 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:45.665489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:45.673398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ddeaf877-ebf9-4711-8e19-2dda6ff85303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.163920 Apr 05 13:50:45.673965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 457/939] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:45 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:46.690765 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:46.691405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:46.697677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:46.698129 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:46.698891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:46.699326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:46.835316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:46.843145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dc7c505a-ea68-4415-aa13-82157d3bf744 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.156395 Apr 05 13:50:46.843742 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 483/940] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:46 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:47.861034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:47.861657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:47.868147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:47.868606 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:47.869391 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:47.869869 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:48.008170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:48.017040 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0fbdc66e-6820-4ecb-9328-9f6650f2a1f0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.160439 Apr 05 13:50:48.017596 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 458/941] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:47 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:49.034281 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:49.034897 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:49.041186 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:49.041641 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:49.042416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:49.042855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:49.188609 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:49.196436 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-60bd4379-dc0f-45e5-994c-4e4632e09809 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.166490 Apr 05 13:50:49.197205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 484/942] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:49 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:50.214215 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:50.214829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:50.221662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:50.222114 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:50.222886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:50.223325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:50.360233 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:50.368686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7aa10e61-7468-4335-a9e5-b8b01de00b24 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.158301 Apr 05 13:50:50.376547 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 459/943] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:50 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:51.386358 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:51.386971 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:51.393434 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:51.393895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:51.394669 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:51.395109 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:51.533508 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:51.541288 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e3c3e1f6-f8a0-4018-91b6-7efaf8b9166d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.159086 Apr 05 13:50:51.541865 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 485/944] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:51 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:52.492718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "884daa4c-0a83-4c91-bb4b-0a594e4b6179", "device": "/dev/sdb"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:52.494411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:52.501490 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:52.501954 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:52.502735 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:52.503180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:52.559440 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:52.561114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:52.567812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:52.568448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:52.569390 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:52.569997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:52.723132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:52.733812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6aad1b2d-446d-42c3-bf19-42182294436c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.177707 Apr 05 13:50:52.735793 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 486/945] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:52 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:52.761180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a9131a5c-600d-4e86-9b81-437a484e04c2 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "POST /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272274 Apr 05 13:50:52.766510 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 460/946] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:50:52 2022] POST /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:50:53.751704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:53.752910 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:53.759540 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:53.759901 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:53.760669 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:53.761151 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:53.911242 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:53.920507 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a2cf9e84-7e81-4c3d-9af8-3bfe2b11d635 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1721 microversion: 2.1 time: 0.172645 Apr 05 13:50:53.921609 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 487/947] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:53 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:54.941253 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:54.941986 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:54.948147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:54.948604 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:54.949376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:54.949820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:55.086732 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:55.095052 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-44c867e8-3828-4b10-b006-a5157853290d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1698 microversion: 2.1 time: 0.158518 Apr 05 13:50:55.095648 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 461/948] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:54 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:55.112244 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-54be8a0c-1fa3-4f39-8eeb-b0f0cbccf2cf tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:50:55.118143 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54be8a0c-1fa3-4f39-8eeb-b0f0cbccf2cf tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:55.118598 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54be8a0c-1fa3-4f39-8eeb-b0f0cbccf2cf tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:55.184821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-54be8a0c-1fa3-4f39-8eeb-b0f0cbccf2cf tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Going to try to start instance {{(pid=123520) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 13:50:55.228215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-54be8a0c-1fa3-4f39-8eeb-b0f0cbccf2cf tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action" status: 202 len: 0 microversion: 2.1 time: 0.120365 Apr 05 13:50:55.228879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 488/949] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:50:55 2022] POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:50:55.237071 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:55.238009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:55.244278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:55.244776 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:55.245589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:55.246182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:55.397619 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:55.405637 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-49a7a056-ddf6-4728-8249-9d94cb687daa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1707 microversion: 2.1 time: 0.172418 Apr 05 13:50:55.406337 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 462/950] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:55 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1707 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:56.425345 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:56.426093 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:56.432564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:56.433012 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:56.433803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:56.434266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:56.575933 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:56.584483 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3275ad28-8d9c-4b07-ba5b-755c3a0a4649 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1707 microversion: 2.1 time: 0.164567 Apr 05 13:50:56.585063 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 489/951] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:56 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:50:57.602889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:50:57.603434 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:50:57.610150 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:57.610608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:57.611373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:50:57.611833 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:50:57.748139 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:50:57.756006 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-54121f13-914e-4934-997c-b93df2dce380 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1711 microversion: 2.1 time: 0.157372 Apr 05 13:50:57.756570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 463/952] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:50:57 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:08.407335 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:08.407878 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:08.409566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2b5bcd3f-ccd0-4460-82c0-ced9c1d37769 req-ccd5a89b-e765-4a59-a16a-392eb3590291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:08.413891 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:08.414612 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:08.415391 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:08.415977 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:08.417820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2b5bcd3f-ccd0-4460-82c0-ced9c1d37769 req-ccd5a89b-e765-4a59-a16a-392eb3590291 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:08.418339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2b5bcd3f-ccd0-4460-82c0-ced9c1d37769 req-ccd5a89b-e765-4a59-a16a-392eb3590291 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:08.430003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2b5bcd3f-ccd0-4460-82c0-ced9c1d37769 req-ccd5a89b-e765-4a59-a16a-392eb3590291 service nova] Creating event network-changed:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:51:08.435138 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2b5bcd3f-ccd0-4460-82c0-ced9c1d37769 req-ccd5a89b-e765-4a59-a16a-392eb3590291 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030034 Apr 05 13:51:08.436095 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 464/953] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:51:08.441811 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:51:08.518089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ea8641e7-c84c-4384-a5c1-d066f21ed1bf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 204 len: 0 microversion: 2.1 time: 0.115321 Apr 05 13:51:08.518607 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 490/954] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:51:08 2022] DELETE /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:51:08.527066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:08.527919 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:08.534263 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:08.534797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:08.535683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:08.536197 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:08.674262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:08.681754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-930e9c7c-249d-420d-9d40-3c9d0e71349c tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.158729 Apr 05 13:51:08.682339 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 465/955] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:08 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:51:09.700600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:09.701429 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:09.708394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:09.708840 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:09.709596 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:09.710027 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:09.846545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:09.854773 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-67f23ada-beb3-4f05-95dd-5c963b1d71fd tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.158386 Apr 05 13:51:09.855653 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 491/956] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:09 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:10.873203 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:10.873764 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:10.883086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:10.883565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:10.884352 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:10.884801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:11.033683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:11.054331 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-33d996d5-8d3d-4964-82a0-b6947d9efeaf tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.184823 Apr 05 13:51:11.054918 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 466/957] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:10 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:12.073268 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:12.073874 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:12.081532 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:12.081976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:12.082732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:12.083299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:12.217519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:12.225422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e179ad8f-5c84-4cc9-9589-97aa4a3642f3 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.155978 Apr 05 13:51:12.225997 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 492/958] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:12 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:13.243310 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:13.244060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:13.251134 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:13.251689 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:13.252492 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:13.252930 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:13.385015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:13.393218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-152aec31-7a76-4667-9022-4bf3245f06d5 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1568 microversion: 2.1 time: 0.154758 Apr 05 13:51:13.393777 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 467/959] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:13 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:14.095145 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-5b37cea1-cce6-4159-840e-d5278f9d3a5f req-9ab8b232-1d7d-4696-b057-5b139d081365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5774fdc2-d449-49b9-837c-a4e9695da6b6", "name": "network-vif-deleted", "tag": "93bae86b-669b-4308-a536-f0b8640d6b10"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:14.104228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-5b37cea1-cce6-4159-840e-d5278f9d3a5f req-9ab8b232-1d7d-4696-b057-5b139d081365 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:14.104712 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-5b37cea1-cce6-4159-840e-d5278f9d3a5f req-9ab8b232-1d7d-4696-b057-5b139d081365 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:14.119517 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-5b37cea1-cce6-4159-840e-d5278f9d3a5f req-9ab8b232-1d7d-4696-b057-5b139d081365 service nova] Creating event network-vif-deleted:93bae86b-669b-4308-a536-f0b8640d6b10 for instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 on hv-cinder-83587 Apr 05 13:51:14.126389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-5b37cea1-cce6-4159-840e-d5278f9d3a5f req-9ab8b232-1d7d-4696-b057-5b139d081365 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034857 Apr 05 13:51:14.127005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 493/960] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:51:14.410761 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:14.411428 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:14.417852 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:14.418336 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:14.419103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:14.419707 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:14.489584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f06c5592fd4c7b9883f59c5501049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8f6f280f0d454aa7ced0d787929726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:14.497958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bd81d45c-756a-453c-840e-7b70d547af99 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 200 len: 1219 microversion: 2.1 time: 0.091415 Apr 05 13:51:14.498863 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 468/961] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:14 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:15.517834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:15.519538 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] [instance: 5774fdc2-d449-49b9-837c-a4e9695da6b6] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:15.525736 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:15.526373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:15.527132 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:15.527979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:15.545204 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] HTTP exception thrown: Instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 could not be found. Apr 05 13:51:15.545616 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Returning 404 to user: Instance 5774fdc2-d449-49b9-837c-a4e9695da6b6 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:51:15.546633 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7295fe04-f314-4f3e-abc6-1d2589da4d80 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6" status: 404 len: 111 microversion: 2.1 time: 0.034209 Apr 05 13:51:15.547526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 494/962] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:15 2022] GET /compute/v2.1/servers/5774fdc2-d449-49b9-837c-a4e9695da6b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:51:15.711745 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e6c691bc-2904-4603-96ab-22f4663f9459 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] Calling method '.version_select at 0x7f9bfd8145e0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:15.730584 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e6c691bc-2904-4603-96ab-22f4663f9459 tempest-TestShelveInstance-1468953902 tempest-TestShelveInstance-1468953902-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1005878422" status: 202 len: 0 microversion: 2.1 time: 0.022525 Apr 05 13:51:15.731380 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 469/963] 10.222.0.59 () {58 vars in 1253 bytes} [Tue Apr 5 13:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1005878422 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:51:17.417020 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:17.417611 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:17.425200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:17.425942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:17.426775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:17.427246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:17.512758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lazy-loading 'services' on Instance uuid 1641e5e1-6e73-4844-a305-acaf94411d60 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:51:17.586985 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bd5ec306-1ef9-4a49-8f28-cf427929bcbb tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60/os-volume_attachments/884daa4c-0a83-4c91-bb4b-0a594e4b6179" status: 202 len: 0 microversion: 2.1 time: 0.173791 Apr 05 13:51:17.591123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 495/964] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:51:17 2022] DELETE /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60/os-volume_attachments/884daa4c-0a83-4c91-bb4b-0a594e4b6179 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:51:18.742277 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:18.742765 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:18.749678 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:18.750104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:18.751108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:18.751561 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:18.778535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:51:18.872742 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-582fd708-41ec-48d7-93d5-38b7953e1c4f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 204 len: 0 microversion: 2.1 time: 0.134443 Apr 05 13:51:18.877003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 470/965] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:51:18 2022] DELETE /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:51:18.884055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:18.884775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:18.893713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:18.894473 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:18.895447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:18.895915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:19.047387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:19.056531 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-782d53f7-19b9-4f78-8137-11bade5d1f9d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1514 microversion: 2.1 time: 0.177982 Apr 05 13:51:19.057388 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 496/966] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:18 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:20.075141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:20.076394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:20.083079 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:20.083671 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:20.084559 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:20.085004 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:20.371230 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:20.378785 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0b33a135-eeb6-478a-8d5c-f4b8515de158 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1514 microversion: 2.1 time: 0.308070 Apr 05 13:51:20.379395 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 471/967] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:20 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:21.183675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7830bab4-9333-4516-85df-bfc23ed67447 req-128eaa37-f2b4-460d-9c9b-69b8046a776d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1641e5e1-6e73-4844-a305-acaf94411d60", "name": "network-vif-deleted", "tag": "54b6925e-7700-4979-a669-01caca6018a0"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:21.192089 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7830bab4-9333-4516-85df-bfc23ed67447 req-128eaa37-f2b4-460d-9c9b-69b8046a776d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:21.192533 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7830bab4-9333-4516-85df-bfc23ed67447 req-128eaa37-f2b4-460d-9c9b-69b8046a776d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:21.204881 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7830bab4-9333-4516-85df-bfc23ed67447 req-128eaa37-f2b4-460d-9c9b-69b8046a776d service nova] Creating event network-vif-deleted:54b6925e-7700-4979-a669-01caca6018a0 for instance 1641e5e1-6e73-4844-a305-acaf94411d60 on hv-cinder-83587 Apr 05 13:51:21.210599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7830bab4-9333-4516-85df-bfc23ed67447 req-128eaa37-f2b4-460d-9c9b-69b8046a776d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030499 Apr 05 13:51:21.211810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 497/968] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:51:21.398270 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:21.398887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:21.405073 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:21.406103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:21.406887 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:21.407325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:21.436943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:21.437308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:21.437772 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lazy-loading 'fault' on Instance uuid 1641e5e1-6e73-4844-a305-acaf94411d60 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:51:21.485873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:21.494080 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-843ed22a-4d19-4774-b295-e17775aa2389 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 200 len: 1309 microversion: 2.1 time: 0.099269 Apr 05 13:51:21.496070 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 472/969] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:21 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:22.514126 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:22.514805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: 1641e5e1-6e73-4844-a305-acaf94411d60] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:22.520850 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:22.521308 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:22.522084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:22.522759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:22.538932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] HTTP exception thrown: Instance 1641e5e1-6e73-4844-a305-acaf94411d60 could not be found. Apr 05 13:51:22.539377 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Returning 404 to user: Instance 1641e5e1-6e73-4844-a305-acaf94411d60 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:51:22.540506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-630b89e1-b3a6-494c-b97a-f05c144b104f tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60" status: 404 len: 111 microversion: 2.1 time: 0.031303 Apr 05 13:51:22.541070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 498/970] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:22 2022] GET /compute/v2.1/servers/1641e5e1-6e73-4844-a305-acaf94411d60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:51:32.446129 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2123713628", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "networks": [{"uuid": "9c68b7e7-b165-40cb-9f4c-5738dd772515"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:32.495204 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] validate_networks() for [('9c68b7e7-b165-40cb-9f4c-5738dd772515', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:51:32.826715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:51:32.827242 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:51:32.827839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:51:32.828257 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:51:32.828716 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:51:32.837142 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:32.837594 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:32.838433 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:32.838876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:32.856273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Getting quotas for project e7a9bd0d7b424d6184c5a0780ae39a79. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:51:32.860831 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Getting quotas for user f916bfa231f74b41958194415fa0b13e and project e7a9bd0d7b424d6184c5a0780ae39a79. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:51:32.871264 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:51:32.874193 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:51:32.918939 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d9551f2d-f2ee-4876-b2ab-2e0e7853d6ed tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476574 Apr 05 13:51:32.919621 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 473/971] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:51:32.930139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-24166526-f489-45c9-9c84-12b6f3dfa6a8 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:32.930753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-24166526-f489-45c9-9c84-12b6f3dfa6a8 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:32.986041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-24166526-f489-45c9-9c84-12b6f3dfa6a8 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:32.993496 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-24166526-f489-45c9-9c84-12b6f3dfa6a8 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1219 microversion: 2.1 time: 0.067222 Apr 05 13:51:32.994138 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 499/972] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:32 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:34.011137 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:34.011976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:34.019383 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:34.019936 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:34.020718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:34.021153 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:34.092289 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:34.101632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0e0f05a1-6ec6-410e-a9fa-f2b806bc72d3 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1277 microversion: 2.1 time: 0.095129 Apr 05 13:51:34.102143 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 474/973] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:34 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:35.119571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:35.120212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:35.128851 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:35.129306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:35.130264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:35.130770 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:35.381781 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:35.390373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d6df2402-cf61-4406-9324-0cce4f3a9ea7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.274626 Apr 05 13:51:35.391205 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 500/974] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:35 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:35.545997 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-9ef90b11-4e18-4cdf-9e63-61decd8e7c3e req-60494890-a10c-4abb-99ee-cf924bcf0ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47e1c79-7271-4167-a24f-ece6c2279c9c", "tag": "9f07b380-085f-4c1d-a901-065e3901193d"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:35.555666 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9ef90b11-4e18-4cdf-9e63-61decd8e7c3e req-60494890-a10c-4abb-99ee-cf924bcf0ae8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:35.556123 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9ef90b11-4e18-4cdf-9e63-61decd8e7c3e req-60494890-a10c-4abb-99ee-cf924bcf0ae8 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:35.569103 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-9ef90b11-4e18-4cdf-9e63-61decd8e7c3e req-60494890-a10c-4abb-99ee-cf924bcf0ae8 service nova] Creating event network-changed:9f07b380-085f-4c1d-a901-065e3901193d for instance e47e1c79-7271-4167-a24f-ece6c2279c9c on hv-cinder-83587 Apr 05 13:51:35.574304 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-9ef90b11-4e18-4cdf-9e63-61decd8e7c3e req-60494890-a10c-4abb-99ee-cf924bcf0ae8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032747 Apr 05 13:51:35.574911 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 475/975] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:51:36.407187 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:36.407821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:36.414709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:36.415160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:36.415975 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:36.416404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:36.550026 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:36.557215 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-eb813a68-730a-47cf-a5a4-ccfbb59592a7 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.153908 Apr 05 13:51:36.557834 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 501/976] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:36 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:37.574970 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:37.575691 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:37.582445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:37.582895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:37.583690 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:37.584125 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:37.715847 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:37.723607 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ac60d221-ce80-400a-b8c6-3982dea4a099 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.153243 Apr 05 13:51:37.724418 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 476/977] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:37 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:38.741126 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:38.741747 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:38.748116 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:38.748569 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:38.750555 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:38.750992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:38.892682 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:38.900160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8d413c6-da61-4958-9c7f-dd566c8d3a50 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.162932 Apr 05 13:51:38.900738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 502/978] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:38 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:39.917716 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:39.918467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:39.925049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:39.925501 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:39.926273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:39.926710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:40.066434 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:40.073752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-45cfd6e6-749c-4dd4-8976-fbc54b2601b5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.160045 Apr 05 13:51:40.074314 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 477/979] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:39 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:41.090091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:41.090700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:41.097160 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:41.097537 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:41.098306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:41.098871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:41.114479 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-08208f29-1946-4ba4-9417-e17422b5e66c req-bc51ceb7-b57f-4392-8a66-c2adf7c48924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47e1c79-7271-4167-a24f-ece6c2279c9c", "name": "network-vif-plugged", "status": "completed", "tag": "9f07b380-085f-4c1d-a901-065e3901193d"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:41.140307 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-08208f29-1946-4ba4-9417-e17422b5e66c req-bc51ceb7-b57f-4392-8a66-c2adf7c48924 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:41.140778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-08208f29-1946-4ba4-9417-e17422b5e66c req-bc51ceb7-b57f-4392-8a66-c2adf7c48924 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:41.153515 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-08208f29-1946-4ba4-9417-e17422b5e66c req-bc51ceb7-b57f-4392-8a66-c2adf7c48924 service nova] Creating event network-vif-plugged:9f07b380-085f-4c1d-a901-065e3901193d for instance e47e1c79-7271-4167-a24f-ece6c2279c9c on hv-cinder-83587 Apr 05 13:51:41.159231 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-08208f29-1946-4ba4-9417-e17422b5e66c req-bc51ceb7-b57f-4392-8a66-c2adf7c48924 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048912 Apr 05 13:51:41.160122 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 478/980] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:51:41.243312 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:41.251415 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aa4641a3-9a4e-4dbf-a6af-3031b7cfac06 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.165157 Apr 05 13:51:41.252030 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 503/981] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:41 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:42.269809 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:42.270511 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:42.276623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:42.277077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:42.277837 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:42.278273 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:42.412788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:42.420029 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a9bb3aae-d627-492f-ab61-366e08363a85 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1319 microversion: 2.1 time: 0.155488 Apr 05 13:51:42.421107 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 479/982] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:42 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:43.437604 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:43.438144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:43.444416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.444861 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.445618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.446052 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.582914 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:43.590476 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-11134afb-47e8-45cb-b9c9-a5ea65d379b6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1508 microversion: 2.1 time: 0.156875 Apr 05 13:51:43.591040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 504/983] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:43 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:43.608067 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02fd74e3-765c-4f49-b8a5-b9d5dd6d6662", "device": "/dev/sdb"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:43.609727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:43.615927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.616373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.617127 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.617564 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.768909 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:43.769405 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:43.775113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.775600 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.776369 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.776805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.802594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:51:43.846208 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ff7f9a45-1481-4df7-aa86-0ef6d1caf8a5 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "POST /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241871 Apr 05 13:51:43.847237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 480/984] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:51:43 2022] POST /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:51:43.884758 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a36b7bf7-38dd-423b-84ba-168d21fbf90e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 204 len: 0 microversion: 2.1 time: 0.120376 Apr 05 13:51:43.885635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 505/985] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:51:43 2022] DELETE /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 13:51:43.895327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:43.896238 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:43.902329 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.902777 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:43.903565 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:43.904002 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:44.037402 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:44.044779 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b24bdb6-90ab-4be0-a33f-31e0670b5950 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1576 microversion: 2.1 time: 0.154138 Apr 05 13:51:44.045346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 481/986] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:43 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:51:45.063915 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:45.064621 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:45.076310 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:45.077497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:45.078465 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:45.078946 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:45.222275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:45.230100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8090212d-59ab-493e-a17e-3a56dcbabb48 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1576 microversion: 2.1 time: 0.171244 Apr 05 13:51:45.230762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 506/987] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:45 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:45.707807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:45.708863 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:45.715755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:45.716212 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:45.716994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:45.718003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:45.803160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lazy-loading 'services' on Instance uuid 9e769137-37bf-4cb2-b020-d664054c61b0 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:51:45.885118 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4739dd0c-db7f-460a-8667-f7261c2dbf8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments/09edaa2e-f426-4b69-b4b4-023cf0452087" status: 202 len: 0 microversion: 2.1 time: 0.181101 Apr 05 13:51:45.886076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 482/988] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:51:45 2022] DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments/09edaa2e-f426-4b69-b4b4-023cf0452087 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:51:46.250421 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:46.251113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:46.257700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:46.258153 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:46.258949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:46.259385 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:46.332054 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:46.341139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-846c6130-6c33-424b-a6cd-35cbd143f4fe tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 200 len: 1509 microversion: 2.1 time: 0.095877 Apr 05 13:51:46.341750 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 507/989] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:46 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 1509 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:46.429057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-702b05b7-d522-4919-80c0-5184ef44aed0 req-8bbba496-0e37-4858-85e7-2bc407ba4162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e672018-0182-4460-8378-999578b50317", "name": "network-vif-deleted", "tag": "cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:46.453441 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-702b05b7-d522-4919-80c0-5184ef44aed0 req-8bbba496-0e37-4858-85e7-2bc407ba4162 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:46.454104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-702b05b7-d522-4919-80c0-5184ef44aed0 req-8bbba496-0e37-4858-85e7-2bc407ba4162 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:46.471176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-702b05b7-d522-4919-80c0-5184ef44aed0 req-8bbba496-0e37-4858-85e7-2bc407ba4162 service nova] Creating event network-vif-deleted:cf0ac88a-9b58-4b93-b8ab-8f5919dd3c94 for instance 4e672018-0182-4460-8378-999578b50317 on hv-cinder-83587 Apr 05 13:51:46.478466 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-702b05b7-d522-4919-80c0-5184ef44aed0 req-8bbba496-0e37-4858-85e7-2bc407ba4162 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054382 Apr 05 13:51:46.479316 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 483/990] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:51:47.358445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:47.359321 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:47.365846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:47.366299 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:47.367071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:47.368118 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:47.382182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] HTTP exception thrown: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. Apr 05 13:51:47.382780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Returning 404 to user: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:51:47.383664 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f259f864-435a-42ef-86d8-8308f6becd89 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 404 len: 111 microversion: 2.1 time: 0.029278 Apr 05 13:51:47.384231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 508/991] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:47 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:51:47.481424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1139689415", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2080643478", "security_groups": [{"name": "tempest-secgroup-smoke-581162300"}], "block_device_mapping_v2": [{"uuid": "9474d963-de9c-4174-ad57-1358bb7bccdf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:47.595049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] validate_networks() for [('d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:51:47.972737 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:51:47.973269 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:51:47.973811 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:51:47.974662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:51:47.975146 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:51:47.985112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:47.985646 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:47.986632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:47.987076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:48.007684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:51:48.012110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for user 507ec53c995341ce805d43f85a4d72c3 and project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:51:48.088471 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:51:48.091160 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9474d963-de9c-4174-ad57-1358bb7bccdf',volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:51:48.220637 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cf3a4fbe-4ba2-4e7f-b2bf-b649abb7c2e4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744067 Apr 05 13:51:48.221278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 484/992] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:51:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:51:48.231545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ee80351c-ed6a-448b-8fb6-80996f1029fa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:48.232985 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ee80351c-ed6a-448b-8fb6-80996f1029fa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:48.285976 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ee80351c-ed6a-448b-8fb6-80996f1029fa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:48.292572 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ee80351c-ed6a-448b-8fb6-80996f1029fa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1095 microversion: 2.1 time: 0.064995 Apr 05 13:51:48.293144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 509/993] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:48 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:49.311034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:49.312309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:49.320262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:49.320798 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:49.321857 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:49.322504 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:49.387331 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:49.395652 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-180f637e-edee-448b-a231-5db895e516bc tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1211 microversion: 2.1 time: 0.089195 Apr 05 13:51:49.396207 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 485/994] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:49 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:50.417634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:50.418955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:50.428495 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:50.429164 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:50.430214 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:50.430836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:50.467033 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2e954277-d2f3-47c0-b2f8-452b41366eca req-06c7b0c4-54db-4222-bfa9-3b8e6ffeb831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a9bc5-b147-4321-91d0-21a2b2523db5", "tag": "03c1e3f4-74cf-4a11-aa5c-ac773207a9fd"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:50.492597 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2e954277-d2f3-47c0-b2f8-452b41366eca req-06c7b0c4-54db-4222-bfa9-3b8e6ffeb831 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:50.493072 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2e954277-d2f3-47c0-b2f8-452b41366eca req-06c7b0c4-54db-4222-bfa9-3b8e6ffeb831 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:50.508487 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2e954277-d2f3-47c0-b2f8-452b41366eca req-06c7b0c4-54db-4222-bfa9-3b8e6ffeb831 service nova] Creating event network-changed:03c1e3f4-74cf-4a11-aa5c-ac773207a9fd for instance 997a9bc5-b147-4321-91d0-21a2b2523db5 on hv-cinder-83587 Apr 05 13:51:50.513616 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2e954277-d2f3-47c0-b2f8-452b41366eca req-06c7b0c4-54db-4222-bfa9-3b8e6ffeb831 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050469 Apr 05 13:51:50.515604 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 486/995] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:51:50.678444 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:50.688401 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fe61de3f-d1b5-427f-a745-c2703c877569 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1278 microversion: 2.1 time: 0.277613 Apr 05 13:51:50.689188 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 510/996] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:50 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:51.706912 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:51.708279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:51.726825 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:51.727296 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:51.728884 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:51.729994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:51.883548 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:51.892506 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-88cfa96e-9888-4acf-80ec-a141456169cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1278 microversion: 2.1 time: 0.190869 Apr 05 13:51:51.893157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 487/997] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:51 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:52.319448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0e99dc2d-dd57-4852-b4f8-eb53d3033480 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:51:52.326079 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e99dc2d-dd57-4852-b4f8-eb53d3033480 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:52.327397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0e99dc2d-dd57-4852-b4f8-eb53d3033480 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:52.350830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0e99dc2d-dd57-4852-b4f8-eb53d3033480 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Going to try to stop instance {{(pid=123520) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 13:51:52.402754 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0e99dc2d-dd57-4852-b4f8-eb53d3033480 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action" status: 202 len: 0 microversion: 2.1 time: 0.086997 Apr 05 13:51:52.403382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 511/998] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:51:52 2022] POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:51:52.412424 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:52.413229 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:52.419052 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:52.419538 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:52.421188 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:52.421655 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:52.587261 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:52.595392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2f59caf6-d4a2-45eb-952e-780a7cd4bffd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.187443 Apr 05 13:51:52.596021 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 488/999] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:52 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:51:52.910511 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:52.911209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:52.917316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:52.917767 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:52.918532 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:52.918971 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:53.057385 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:53.065282 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-644ccc4e-e10b-41c0-8840-c80c848261b3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.159061 Apr 05 13:51:53.065855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 512/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:52 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:53.614465 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:53.615114 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:53.621439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:53.621899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:53.622669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:53.623117 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:53.755097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:53.762310 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-175e1e23-2f82-4c08-9bee-912da6b207f5 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.151689 Apr 05 13:51:53.762876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 489/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:53 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:54.082624 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:54.083270 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:54.089287 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:54.089738 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:54.090497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:54.090937 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:54.224640 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:54.231746 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f0a7ecb6-1b55-44b0-954a-41590ebbb9db tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.152971 Apr 05 13:51:54.232314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 513/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:54 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:54.779189 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:54.780576 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:54.786829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:54.787275 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:54.788083 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:54.788519 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:54.918738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:54.928965 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6497467f-0eda-43a3-8f3d-20bc4e021d16 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.153547 Apr 05 13:51:54.929539 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 490/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:54 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:55.248652 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:55.249245 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:55.255602 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:55.256077 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:55.256836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:55.257297 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:55.394339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:55.401578 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6d855aa8-9902-42c4-b2f6-1a0a88055387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.156822 Apr 05 13:51:55.402158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 514/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:55 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:55.946758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:55.947327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:55.954996 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:55.955779 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:55.956572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:55.957096 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:56.095320 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:56.102836 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3105c74e-fc89-494d-903c-181018465b7c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.160098 Apr 05 13:51:56.103404 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 491/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:55 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:56.202113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:51:56.202304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:51:56.419295 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:56.419998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:56.426724 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:56.427172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:56.427963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:56.428397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:56.562326 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:56.569591 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-23344deb-0306-4edb-b78b-b5e186f05bf6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.154163 Apr 05 13:51:56.570162 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 515/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:56 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:57.119254 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:57.119839 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:57.127029 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:57.127486 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:57.128280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:57.128718 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:57.265077 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:57.272252 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-339ab74f-1f1a-4ab1-95df-08d5fbc113d7 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.156939 Apr 05 13:51:57.272808 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 492/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:57 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:57.586059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:57.586672 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:57.593529 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:57.593982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:57.594745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:57.595183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:57.733040 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:57.741059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8beed791-412b-453f-b990-e941e3206266 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.158731 Apr 05 13:51:57.741655 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 516/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:57 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:58.289780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:58.290394 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:58.297005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:58.297457 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:58.298226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:58.298669 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:58.437215 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:58.445393 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef68c1b0-c2f8-42ef-8d52-4e1bff8da303 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.158530 Apr 05 13:51:58.445962 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 493/1009] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:58 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:58.758432 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:58.759166 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:58.766469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:58.766919 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:58.767722 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:58.768158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:58.908828 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:58.916279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f0f38842-3187-4ed8-ae94-accb6fc940d7 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.162087 Apr 05 13:51:58.916846 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 517/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:58 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:59.463201 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:59.463778 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:59.470005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:59.470454 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:59.471205 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:59.471673 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:59.602031 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:51:59.610618 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-745e5679-5d35-40ba-a969-c8d71484fcda tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.151317 Apr 05 13:51:59.611188 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 494/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:59 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:51:59.932858 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:51:59.933608 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:51:59.939805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:59.940256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:51:59.941025 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:51:59.941464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:00.080347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:00.087577 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cbd1c172-9b63-4c6f-a977-12b4cc83b51a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.158494 Apr 05 13:52:00.088144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 518/1012] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:51:59 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:00.628113 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:00.628724 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:00.634855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:00.635309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:00.636112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:00.636546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:00.768294 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:00.776185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2ddcb164-06de-491a-a61b-25ea8be030d8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.151971 Apr 05 13:52:00.776741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 495/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:00 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:01.004002 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:52:01.004464 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:52:01.105238 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:01.105879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:01.112228 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:01.112679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:01.113442 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:01.113877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:01.249466 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:01.256800 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-45d19b92-ccda-4158-8897-501da2e1d99f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.155391 Apr 05 13:52:01.257366 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 519/1014] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:01 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:01.794896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:01.796066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:01.802646 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:01.803097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:01.803895 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:01.804333 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:01.942891 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:01.950109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cd514105-d048-4a0a-aa87-ee09f54c086e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.160141 Apr 05 13:52:01.950667 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 496/1015] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:01 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:02.273745 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:02.274389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:02.281424 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:02.281875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:02.282634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:02.283072 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:02.415230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:02.422964 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-635ea8c4-1707-41fd-b99e-d9b5506e686c tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.153123 Apr 05 13:52:02.423550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 520/1016] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:02 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:02.967049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:02.967695 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:02.974228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:02.974683 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:02.975458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:02.975927 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:03.112533 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:03.119889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a989faea-f2fa-48fc-b648-8439bffc1c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.156741 Apr 05 13:52:03.120550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 497/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:02 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:03.440387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:03.441017 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:03.447209 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:03.447805 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:03.448584 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:03.448999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:03.580850 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:03.589123 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed54db46-a925-463f-b6cf-42746ccee47b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.153421 Apr 05 13:52:03.589694 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 521/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:03 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:04.138387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:04.139907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:04.146266 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:04.146797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:04.147688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:04.148200 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:04.298730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:04.306120 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-41a165f6-4542-4c90-959e-7e3ae76b328b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.171627 Apr 05 13:52:04.306696 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 498/1019] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:04 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:04.606005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:04.606798 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:04.613404 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:04.613962 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:04.614792 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:04.615469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:04.765146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:04.773204 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aba6b55e-7fc7-4432-9d96-c6852b95c2a3 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.170851 Apr 05 13:52:04.773808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 522/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:04 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:05.301416 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:05.301913 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:05.308171 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.308623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.309390 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.309827 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.323699 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:05.324314 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:05.330534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.330982 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.331762 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.332230 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.391141 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lazy-loading 'services' on Instance uuid e47e1c79-7271-4167-a24f-ece6c2279c9c {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:52:05.464744 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b5d3ff1d-4386-44e3-8ae9-430e500597c6 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c/os-volume_attachments/02fd74e3-765c-4f49-b8a5-b9d5dd6d6662" status: 202 len: 0 microversion: 2.1 time: 0.167072 Apr 05 13:52:05.465633 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 499/1021] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:52:05 2022] DELETE /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c/os-volume_attachments/02fd74e3-765c-4f49-b8a5-b9d5dd6d6662 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:52:05.481194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:05.495062 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77a876a7-bf90-4cb3-aa9a-88f65355e13a tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.175076 Apr 05 13:52:05.495775 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 523/1022] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:05 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:52:05.790900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:05.791645 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:05.798027 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.798482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.799263 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:05.799741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:05.943793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:05.951568 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2d246ddf-05df-4202-98ef-f6a47b946192 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.164750 Apr 05 13:52:05.952309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 500/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:05 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:06.512659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:06.513272 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:06.520059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.520582 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.521347 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.521780 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.601485 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:06.602034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:06.609748 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.610199 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.610969 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.611401 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.635662 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:52:06.656301 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:06.663778 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f9b721ec-b373-47f7-9cf9-996b882ea0a6 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.154865 Apr 05 13:52:06.664773 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 524/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:06 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:06.712730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-435f5e16-ca22-4edd-8fd1-fb95512e1203 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 204 len: 0 microversion: 2.1 time: 0.115215 Apr 05 13:52:06.713379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 501/1025] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:52:06 2022] DELETE /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:52:06.723322 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:06.724231 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:06.730514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.730968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.731771 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.732259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.866871 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:06.874194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9965a672-0d17-4005-9592-68e81d516784 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1514 microversion: 2.1 time: 0.155610 Apr 05 13:52:06.874759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 525/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:06 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:52:06.969451 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:06.970138 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:06.976236 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.976684 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:06.977438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:06.977871 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:07.113789 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:07.121180 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-44c6e2f6-b40a-4706-a9a9-4d8bc6723f9b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.156446 Apr 05 13:52:07.121752 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 502/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:06 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:07.215708 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-a990b69f-df28-41b7-a6d2-a9c0be0034dc req-fb80bcb6-2d60-4f29-852e-413f270599f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997a9bc5-b147-4321-91d0-21a2b2523db5", "name": "network-vif-plugged", "status": "completed", "tag": "03c1e3f4-74cf-4a11-aa5c-ac773207a9fd"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:07.224806 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a990b69f-df28-41b7-a6d2-a9c0be0034dc req-fb80bcb6-2d60-4f29-852e-413f270599f7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:07.225264 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a990b69f-df28-41b7-a6d2-a9c0be0034dc req-fb80bcb6-2d60-4f29-852e-413f270599f7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:07.237574 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-a990b69f-df28-41b7-a6d2-a9c0be0034dc req-fb80bcb6-2d60-4f29-852e-413f270599f7 service nova] Creating event network-vif-plugged:03c1e3f4-74cf-4a11-aa5c-ac773207a9fd for instance 997a9bc5-b147-4321-91d0-21a2b2523db5 on hv-cinder-83587 Apr 05 13:52:07.242514 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-a990b69f-df28-41b7-a6d2-a9c0be0034dc req-fb80bcb6-2d60-4f29-852e-413f270599f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Apr 05 13:52:07.243113 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 526/1028] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:52:07.682055 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:07.682657 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:07.689309 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:07.689757 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:07.690512 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:07.690942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:07.819824 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:07.827753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-68dcb731-fbd4-4931-8ad9-d707ea9243e2 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1675 microversion: 2.1 time: 0.149503 Apr 05 13:52:07.828427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 503/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:07 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:07.892599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:07.893293 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:07.899382 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:07.899856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:07.900615 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:07.901046 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:08.032709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:08.040131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-76bff6c1-f22c-458b-8ff2-32dd130aa6a9 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1514 microversion: 2.1 time: 0.152832 Apr 05 13:52:08.040720 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 527/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:07 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:08.138053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:08.138943 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:08.144780 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:08.145221 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:08.145976 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:08.146408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:08.300157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:08.308630 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c6958a7d-0a0d-438c-bfa1-f68f51930bbd tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.174434 Apr 05 13:52:08.309206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 504/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:08 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:08.844133 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:08.844728 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:08.850924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:08.851368 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:08.852189 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:08.852618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.057053 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:09.057703 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:09.064167 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.064655 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.065403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.065842 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.204530 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:09.211920 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ce0ba7d5-1379-409b-acce-ef3c0ca2e92d tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1514 microversion: 2.1 time: 0.158710 Apr 05 13:52:09.212482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 505/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:09 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:09.326427 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:09.327046 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:09.333473 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.333935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.334712 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.335290 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.352709 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:09.361071 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-91e98d56-3ce7-4a8c-b1c6-e56dbf97b2aa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1652 microversion: 2.1 time: 0.520815 Apr 05 13:52:09.361656 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 528/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:08 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1652 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:09.378526 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0895031e-d9a2-4953-91dd-e85fb27d812c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:09.384407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0895031e-d9a2-4953-91dd-e85fb27d812c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.384877 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0895031e-d9a2-4953-91dd-e85fb27d812c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.407610 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0895031e-d9a2-4953-91dd-e85fb27d812c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Going to try to start instance {{(pid=123520) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 13:52:09.450908 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0895031e-d9a2-4953-91dd-e85fb27d812c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action" status: 202 len: 0 microversion: 2.1 time: 0.075928 Apr 05 13:52:09.451862 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 529/1034] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Apr 5 13:52:09 2022] POST /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:52:09.460545 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:09.461380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:09.468538 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.468744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.469389 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.469797 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.489542 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:09.499539 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2be851ae-769c-4ecb-b53e-43ed818df98f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1266 microversion: 2.1 time: 0.177129 Apr 05 13:52:09.500700 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 506/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:09 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:52:09.735676 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:09.743361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-15a50309-aeda-4ac2-a5fe-8db14a017c67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1661 microversion: 2.1 time: 0.287159 Apr 05 13:52:09.744279 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 530/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:09 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1661 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:52:09.818659 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-38210f82-45d4-4c92-b610-143ecaf74c83 req-cb640bdd-a61b-4e3f-9edd-1d98fd00cc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47e1c79-7271-4167-a24f-ece6c2279c9c", "name": "network-vif-deleted", "tag": "9f07b380-085f-4c1d-a901-065e3901193d"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:09.827078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-38210f82-45d4-4c92-b610-143ecaf74c83 req-cb640bdd-a61b-4e3f-9edd-1d98fd00cc61 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:09.827543 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-38210f82-45d4-4c92-b610-143ecaf74c83 req-cb640bdd-a61b-4e3f-9edd-1d98fd00cc61 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:09.838094 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-38210f82-45d4-4c92-b610-143ecaf74c83 req-cb640bdd-a61b-4e3f-9edd-1d98fd00cc61 service nova] Creating event network-vif-deleted:9f07b380-085f-4c1d-a901-065e3901193d for instance e47e1c79-7271-4167-a24f-ece6c2279c9c on hv-cinder-83587 Apr 05 13:52:09.843765 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-38210f82-45d4-4c92-b610-143ecaf74c83 req-cb640bdd-a61b-4e3f-9edd-1d98fd00cc61 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 Apr 05 13:52:09.844353 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 507/1037] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:52:10.229106 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:10.229634 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:10.236445 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.236892 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.237658 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.238091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.267852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.268292 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.269139 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lazy-loading 'fault' on Instance uuid e47e1c79-7271-4167-a24f-ece6c2279c9c {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:52:10.307707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f916bfa231f74b41958194415fa0b13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a9bd0d7b424d6184c5a0780ae39a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:10.315453 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-92e0786f-d8ba-47f7-b54e-a18ec9bdc2b4 tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 200 len: 1309 microversion: 2.1 time: 0.090287 Apr 05 13:52:10.316173 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 531/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:10 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:10.516818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:10.517478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:10.523577 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.524039 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.524807 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.525246 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.664379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:10.672436 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-600a6889-e2ea-418f-a794-bad7cf4fd707 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1452 microversion: 2.1 time: 0.160400 Apr 05 13:52:10.673003 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 508/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:10 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:10.688275 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:10.688884 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:10.694543 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.694990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.695761 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.696191 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.761634 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:10.762261 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:10.768935 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.769356 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.770133 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:10.770566 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:10.880229 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:10.890240 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-275b8528-afe0-45c9-8dcb-23665c85d330 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1452 microversion: 2.1 time: 0.205865 Apr 05 13:52:10.892306 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 532/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:10 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:10.926226 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:10.933654 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f675c994-242e-44e3-8fe8-9f025cf61bdb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1661 microversion: 2.1 time: 0.175920 Apr 05 13:52:10.934411 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 509/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:10 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1661 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:52:11.332777 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:11.333303 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] [instance: e47e1c79-7271-4167-a24f-ece6c2279c9c] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:11.342732 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:11.343190 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:11.344087 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:11.344531 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:11.359083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] HTTP exception thrown: Instance e47e1c79-7271-4167-a24f-ece6c2279c9c could not be found. Apr 05 13:52:11.359707 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] Returning 404 to user: Instance e47e1c79-7271-4167-a24f-ece6c2279c9c could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:52:11.360546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77b2001c-1da7-41c8-9924-d1be13e7ccfa tempest-VolumesSnapshotTestJSON-1539301341 tempest-VolumesSnapshotTestJSON-1539301341-project] 10.222.0.59 "GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c" status: 404 len: 111 microversion: 2.1 time: 0.031808 Apr 05 13:52:11.361094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 533/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:11 2022] GET /compute/v2.1/servers/e47e1c79-7271-4167-a24f-ece6c2279c9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:52:11.952363 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:11.953198 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:11.959866 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:11.960409 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:11.961279 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:11.961792 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:12.211931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:12.219991 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-50cb4213-5f72-4b57-b573-e00d63966fc8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1661 microversion: 2.1 time: 0.272092 Apr 05 13:52:12.220570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 510/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:11 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1661 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:12.978810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-43437c8b-f823-42cb-9bdd-09ba226e911a req-5a0f9ce5-4d9c-4220-aa22-7805027defe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a9bc5-b147-4321-91d0-21a2b2523db5", "tag": "03c1e3f4-74cf-4a11-aa5c-ac773207a9fd"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:12.987565 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-43437c8b-f823-42cb-9bdd-09ba226e911a req-5a0f9ce5-4d9c-4220-aa22-7805027defe0 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:12.990920 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-43437c8b-f823-42cb-9bdd-09ba226e911a req-5a0f9ce5-4d9c-4220-aa22-7805027defe0 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:13.002759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-43437c8b-f823-42cb-9bdd-09ba226e911a req-5a0f9ce5-4d9c-4220-aa22-7805027defe0 service nova] Creating event network-changed:03c1e3f4-74cf-4a11-aa5c-ac773207a9fd for instance 997a9bc5-b147-4321-91d0-21a2b2523db5 on hv-cinder-83587 Apr 05 13:52:13.009155 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-43437c8b-f823-42cb-9bdd-09ba226e911a req-5a0f9ce5-4d9c-4220-aa22-7805027defe0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033860 Apr 05 13:52:13.012111 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 534/1044] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:52:13.237677 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:13.238412 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:13.244942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:13.245551 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:13.246372 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:13.246819 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:13.387149 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:13.395595 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2cf37a6c-3bdb-4abf-bf72-440f66bf2636 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1665 microversion: 2.1 time: 0.161818 Apr 05 13:52:13.396175 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 511/1045] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:13 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:46.964836 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:46.965927 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:46.972029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:46.972486 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:46.973248 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:46.973938 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:47.001924 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-24f4e884-73f3-40e6-803c-56df516555b0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042069 Apr 05 13:52:47.002502 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 535/1046] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:52:46 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:52:47.058026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:47.059271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:47.064961 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:47.065405 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:47.066173 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:47.067157 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:47.091635 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:52:47.168942 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bc88e430-978b-47aa-b582-50bd507b97ba tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 204 len: 0 microversion: 2.1 time: 0.113765 Apr 05 13:52:47.169977 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 512/1047] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:52:47 2022] DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:52:47.177993 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:47.178589 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:47.185870 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:47.186316 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:47.187083 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:47.187547 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:47.318563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:47.326059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-de7fa6a2-5b38-40a1-9467-2a05c535d6db tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1671 microversion: 2.1 time: 0.151849 Apr 05 13:52:47.326618 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 536/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:47 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:48.345108 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:48.345797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:48.352529 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:48.352971 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:48.353734 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:48.354167 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:48.491958 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:48.499709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-aa437ecc-34a9-4ee4-9845-8229ae7ec526 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1671 microversion: 2.1 time: 0.159614 Apr 05 13:52:48.500271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 513/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:48 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:49.518087 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:49.518685 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:49.524811 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:49.525269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:49.526001 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:49.526433 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:49.779779 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:49.786963 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-18147877-055a-4e38-b6ad-a8f9d083acea tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 200 len: 1671 microversion: 2.1 time: 0.272713 Apr 05 13:52:49.787554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 537/1050] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:49 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:50.225545 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-677df446-a952-4695-ad55-a39ba3d5122c req-6ffb67f8-16cd-45eb-a7ad-4b7f78eae797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e769137-37bf-4cb2-b020-d664054c61b0", "name": "network-vif-deleted", "tag": "68b098ba-9acc-40b2-a9c1-81e4551c96cc"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:50.237844 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-677df446-a952-4695-ad55-a39ba3d5122c req-6ffb67f8-16cd-45eb-a7ad-4b7f78eae797 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:50.238494 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-677df446-a952-4695-ad55-a39ba3d5122c req-6ffb67f8-16cd-45eb-a7ad-4b7f78eae797 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:50.252204 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-677df446-a952-4695-ad55-a39ba3d5122c req-6ffb67f8-16cd-45eb-a7ad-4b7f78eae797 service nova] Creating event network-vif-deleted:68b098ba-9acc-40b2-a9c1-81e4551c96cc for instance 9e769137-37bf-4cb2-b020-d664054c61b0 on hv-cinder-83587 Apr 05 13:52:50.257381 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-677df446-a952-4695-ad55-a39ba3d5122c req-6ffb67f8-16cd-45eb-a7ad-4b7f78eae797 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035878 Apr 05 13:52:50.258062 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 514/1051] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:52:50.804278 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:50.804888 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:50.811431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:50.811895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:50.812668 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:50.813106 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:50.826873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. Apr 05 13:52:50.827469 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:52:50.828331 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-93eacabe-bff4-4102-86da-b5e18fa304cc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 404 len: 111 microversion: 2.1 time: 0.027982 Apr 05 13:52:50.828889 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 538/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:50 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:52:50.837746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e2732ca9-1eb6-4a04-adca-49ce0ff6f8ec tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '.version_select at 0x7f9bfd86b790>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:50.862121 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e2732ca9-1eb6-4a04-adca-49ce0ff6f8ec tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67238975" status: 202 len: 0 microversion: 2.1 time: 0.028436 Apr 05 13:52:50.862710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 515/1053] 10.222.0.59 () {58 vars in 1214 bytes} [Tue Apr 5 13:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67238975 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:52:51.517999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: .version_select at 0x7f9bfd76eee0>, body: {"keypair": {"name": "tempest-keypair-1338498836"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:51.532734 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:52:51.536554 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:52:51.685018 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:52:51.688520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:52:51.701412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-feb0bd92-82dd-4d6f-999b-fe7f5cd69f8e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.187320 Apr 05 13:52:51.702005 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 539/1054] 10.222.0.59 () {60 vars in 1157 bytes} [Tue Apr 5 13:52:51 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:53.221582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-218232970", "imageRef": "f140d7f7-67d4-46a9-9acc-ead3f30a37a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a7d363c-9c87-49b2-bb34-1ae457fa3d44"}], "security_groups": [{"name": "tempest-securitygroup--1825449809"}], "key_name": "tempest-keypair-1338498836", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:53.325482 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] validate_networks() for [('6a7d363c-9c87-49b2-bb34-1ae457fa3d44', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:52:53.693147 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:52:53.693572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:52:53.694049 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:52:53.694488 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:52:53.694910 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:52:53.704956 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:53.705438 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:53.706245 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:53.706698 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:53.723026 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:52:53.727092 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Getting quotas for user 4d6b3af744dd4f3798ec98381104575f and project 2edcb781e01b4c57b680098d732cb8d3. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:52:53.738061 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:52:53.740453 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f140d7f7-67d4-46a9-9acc-ead3f30a37a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:52:53.789163 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bd9b187a-6eee-4e08-ae1a-8605670ba8d0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571910 Apr 05 13:52:53.789820 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 516/1055] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:52:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:52:53.800450 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-055e4673-6f6a-4259-826d-99ab52406f6f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:53.801065 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-055e4673-6f6a-4259-826d-99ab52406f6f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:53.855066 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-055e4673-6f6a-4259-826d-99ab52406f6f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:53.862082 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-055e4673-6f6a-4259-826d-99ab52406f6f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1237 microversion: 2.1 time: 0.065680 Apr 05 13:52:53.862703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 540/1056] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:53 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:54.880012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:54.880717 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:54.888005 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:54.889489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:54.890327 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:54.890829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:54.950172 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:54.957786 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-012a714e-82e2-46d6-85a4-1103ea87a8c9 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1295 microversion: 2.1 time: 0.082201 Apr 05 13:52:54.958641 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 517/1057] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:54 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:55.975938 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:55.976549 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:55.983938 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:55.984422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:55.985201 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:55.985639 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:56.017952 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-d416f864-4869-4102-bc43-9dde1e97c699 req-a1ef3d23-31bd-47fc-b259-4d52806fa0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa22c83d-be5e-4f5a-a41d-20204d6de425", "tag": "e75e4cea-332c-4c5c-b9b7-18028f80e7da"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:52:56.033715 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d416f864-4869-4102-bc43-9dde1e97c699 req-a1ef3d23-31bd-47fc-b259-4d52806fa0b1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:56.034371 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d416f864-4869-4102-bc43-9dde1e97c699 req-a1ef3d23-31bd-47fc-b259-4d52806fa0b1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:56.052575 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-d416f864-4869-4102-bc43-9dde1e97c699 req-a1ef3d23-31bd-47fc-b259-4d52806fa0b1 service nova] Creating event network-changed:e75e4cea-332c-4c5c-b9b7-18028f80e7da for instance fa22c83d-be5e-4f5a-a41d-20204d6de425 on hv-cinder-83587 Apr 05 13:52:56.064513 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-d416f864-4869-4102-bc43-9dde1e97c699 req-a1ef3d23-31bd-47fc-b259-4d52806fa0b1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055067 Apr 05 13:52:56.065121 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 518/1058] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:52:56.253697 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:56.260847 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b38b33b5-64da-49f2-8073-f54a2dc63699 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.289336 Apr 05 13:52:56.261416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 541/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:55 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:57.278905 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:57.279623 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:57.285727 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:57.286183 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:57.286946 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:57.287382 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:57.425065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:57.432402 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c05e6790-04f3-4a0c-a879-77f549cfc63f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.158227 Apr 05 13:52:57.432978 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 519/1060] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:57 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:58.449182 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:58.450033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:58.456546 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:58.456999 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:58.457759 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:58.458212 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:58.592895 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:58.600472 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a49b3088-b171-48ca-8c8f-8b3aa7764963 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.155191 Apr 05 13:52:58.601041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 542/1061] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:58 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:52:59.617015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:52:59.617629 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:52:59.624169 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:59.624620 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:59.625389 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:52:59.625829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:52:59.762769 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:52:59.770044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-96473a33-b7dc-4770-89e0-5b1028ba8e5e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.156891 Apr 05 13:52:59.770605 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 520/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:52:59 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:00.787413 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:00.788064 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:00.795259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:00.795744 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:00.796513 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:00.796955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:00.928753 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:00.937829 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-70c441b1-d953-48b9-946c-6bdcc630d858 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.154274 Apr 05 13:53:00.938399 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 543/1063] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:00 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:01.447325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-9e70824b-0082-4b4d-a09a-888898129a05 req-cd96ba97-eca5-48c5-ac86-d964caa2a1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa22c83d-be5e-4f5a-a41d-20204d6de425", "name": "network-vif-plugged", "status": "completed", "tag": "e75e4cea-332c-4c5c-b9b7-18028f80e7da"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:01.456615 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9e70824b-0082-4b4d-a09a-888898129a05 req-cd96ba97-eca5-48c5-ac86-d964caa2a1ae service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:01.457086 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9e70824b-0082-4b4d-a09a-888898129a05 req-cd96ba97-eca5-48c5-ac86-d964caa2a1ae service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:01.469873 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-9e70824b-0082-4b4d-a09a-888898129a05 req-cd96ba97-eca5-48c5-ac86-d964caa2a1ae service nova] Creating event network-vif-plugged:e75e4cea-332c-4c5c-b9b7-18028f80e7da for instance fa22c83d-be5e-4f5a-a41d-20204d6de425 on hv-cinder-83587 Apr 05 13:53:01.474874 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-9e70824b-0082-4b4d-a09a-888898129a05 req-cd96ba97-eca5-48c5-ac86-d964caa2a1ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031142 Apr 05 13:53:01.475583 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 521/1064] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:01.954739 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:01.955286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:01.961591 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:01.962078 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:01.962863 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:01.963296 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:02.099990 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:02.107443 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-08cc6928-4b62-49da-9588-279f3bc458cd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.156698 Apr 05 13:53:02.108041 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 544/1065] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:01 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:53:03.125775 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:03.126408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:03.132370 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:03.132805 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:03.133572 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:03.134009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:03.268029 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:03.275220 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6f31bfe4-55fa-4d79-8980-2cfeda1b930e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1363 microversion: 2.1 time: 0.154634 Apr 05 13:53:03.275827 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 522/1066] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:03 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:53:04.293786 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:04.294397 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:04.300642 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:04.301084 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:04.301844 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:04.302269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:04.434812 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:04.441955 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-53c4dec2-837a-45d0-abeb-b7242d2407eb tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1548 microversion: 2.1 time: 0.152646 Apr 05 13:53:04.442568 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 545/1067] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:04 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:04.458573 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:04.459076 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:04.465980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:04.466437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:04.467237 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:04.467709 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:04.560725 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-550f8395-0001-4aa1-9754-1f9ba70ba6de tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105896 Apr 05 13:53:04.561328 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 523/1068] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Apr 5 13:53:04 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:05.511033 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7bc8caed-7d47-46c2-868f-ecae6d93a2ff req-71c5adce-ca57-4403-b7c8-3fa32b7041fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa22c83d-be5e-4f5a-a41d-20204d6de425", "tag": "e75e4cea-332c-4c5c-b9b7-18028f80e7da"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:05.520294 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7bc8caed-7d47-46c2-868f-ecae6d93a2ff req-71c5adce-ca57-4403-b7c8-3fa32b7041fa service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:05.520821 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7bc8caed-7d47-46c2-868f-ecae6d93a2ff req-71c5adce-ca57-4403-b7c8-3fa32b7041fa service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:05.531525 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7bc8caed-7d47-46c2-868f-ecae6d93a2ff req-71c5adce-ca57-4403-b7c8-3fa32b7041fa service nova] Creating event network-changed:e75e4cea-332c-4c5c-b9b7-18028f80e7da for instance fa22c83d-be5e-4f5a-a41d-20204d6de425 on hv-cinder-83587 Apr 05 13:53:05.536826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7bc8caed-7d47-46c2-868f-ecae6d93a2ff req-71c5adce-ca57-4403-b7c8-3fa32b7041fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029551 Apr 05 13:53:05.537843 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 546/1069] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:41.375209 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:41.375829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:41.381670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:41.382125 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:41.382894 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:41.383334 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:41.405740 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a56f8398-0518-426f-9f6c-b1300ea8d803 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/ips" status: 200 len: 144 microversion: 2.1 time: 0.035589 Apr 05 13:53:41.406298 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 524/1070] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Apr 5 13:53:41 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:42.712066 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc83ae83-6a4f-45c9-a64e-0edc49878387"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:42.713200 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:42.719795 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:42.720246 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:42.721037 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:42.721475 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:45.449679 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5324be8a-5901-4aba-9d9c-a535b6ee54f8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.742241 Apr 05 13:53:45.451053 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 547/1071] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:53:42 2022] POST /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 194 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:48.243980 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-352780973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2080643478", "security_groups": [{"name": "tempest-secgroup-smoke-581162300"}], "block_device_mapping_v2": [{"uuid": "537df3bf-3e06-4dcc-97f1-8805179c3363", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:48.407486 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] validate_networks() for [('d4a95ed4-c1ca-4a1a-ae8c-2440a83e1601', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 13:53:49.041645 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 13:53:49.042089 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 13:53:49.042570 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 13:53:49.043428 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 13:53:49.043876 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 13:53:49.055323 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:49.055806 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:49.056610 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:49.057044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:49.078325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 13:53:49.082206 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Getting quotas for user 507ec53c995341ce805d43f85a4d72c3 and project aa8d9df8c7bc47c198fe0d94abd938c8. Resources: {'ram', 'cores', 'instances'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 13:53:49.139097 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 13:53:49.141271 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='537df3bf-3e06-4dcc-97f1-8805179c3363',volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 13:53:49.264478 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c4f6db3d-afa0-4314-bdcd-51e103ddd246 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.024199 Apr 05 13:53:49.265431 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 525/1072] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Apr 5 13:53:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 13:53:49.276146 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4aa00514-b278-4eea-9f1d-6394e54c822b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:49.276840 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4aa00514-b278-4eea-9f1d-6394e54c822b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:49.333906 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4aa00514-b278-4eea-9f1d-6394e54c822b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:49.340402 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4aa00514-b278-4eea-9f1d-6394e54c822b tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1094 microversion: 2.1 time: 0.068961 Apr 05 13:53:49.341042 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 548/1073] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:49 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:50.361284 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:50.362011 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:50.369938 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:50.370403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:50.371194 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:50.371670 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:50.433395 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:50.441387 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-544b1f9b-3ed6-4976-8fd7-b2dc149c66a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1210 microversion: 2.1 time: 0.086390 Apr 05 13:53:50.442218 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 526/1074] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:50 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:51.459013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:51.459787 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:51.467571 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:51.468115 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:51.469124 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:51.469760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:51.986457 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:51.995638 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-db74e852-022d-45fa-b66f-a1d947543bef tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1277 microversion: 2.1 time: 0.540893 Apr 05 13:53:52.000643 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 549/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:51 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1277 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:52.274688 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-7d1e96e3-514a-48fc-96d7-0a2080216a4c req-49abb0b7-d95a-47ff-90bc-9ad621945daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cdf3f9-e14a-4b05-a303-bcd408f993eb", "tag": "ecac3f52-db01-476e-8a60-e585d080e046"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:52.285632 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-7d1e96e3-514a-48fc-96d7-0a2080216a4c req-49abb0b7-d95a-47ff-90bc-9ad621945daf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:52.286091 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-7d1e96e3-514a-48fc-96d7-0a2080216a4c req-49abb0b7-d95a-47ff-90bc-9ad621945daf service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:52.298398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-7d1e96e3-514a-48fc-96d7-0a2080216a4c req-49abb0b7-d95a-47ff-90bc-9ad621945daf service nova] Creating event network-changed:ecac3f52-db01-476e-8a60-e585d080e046 for instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb on hv-cinder-83587 Apr 05 13:53:52.303734 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-7d1e96e3-514a-48fc-96d7-0a2080216a4c req-49abb0b7-d95a-47ff-90bc-9ad621945daf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106305 Apr 05 13:53:52.304710 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 527/1076] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:52.952180 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:52.953151 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:52.959324 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:52.959804 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:52.960564 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:52.960998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:52.989949 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-32224328-0af6-49c0-a723-d87a62acc2a8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 Apr 05 13:53:52.990523 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 550/1077] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:53:52 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:53:53.000877 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:53.001571 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:53.007545 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:53.007994 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:53.008758 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:53.009191 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:53.017166 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:53.018421 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:53.024896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:53.025422 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:53.026271 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:53.026785 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:53.038351 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ed8ce8d1-407e-4114-b1ac-e9c9189e6ec3 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387" status: 200 len: 194 microversion: 2.1 time: 0.041718 Apr 05 13:53:53.039228 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 528/1078] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Apr 5 13:53:52 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:53:53.283387 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:53.297054 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-06bfc4a4-922c-41e2-8e4e-c39c55d5c231 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.284317 Apr 05 13:53:53.297992 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 551/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:53 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:53:54.313769 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:54.314376 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:54.321009 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:54.321458 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:54.322262 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:54.322697 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:54.353006 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "223745ba-ceb2-48c1-9c61-9b37d7b27446"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:53:54.354061 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:54.361361 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:54.361807 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:54.362588 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:54.363023 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:54.467941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:54.476505 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-09ef641e-a2fe-4e88-a4aa-2139f5fe0726 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.166729 Apr 05 13:53:54.477078 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 529/1080] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:54 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:54.604100 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-87394909-fb5b-4b31-9516-7e3092f69ccd tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "POST /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254759 Apr 05 13:53:54.604728 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 552/1081] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Apr 5 13:53:54 2022] POST /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:53:55.493321 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:55.493940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:55.500408 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:55.500857 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:55.501624 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:55.502065 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:55.638164 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:55.645720 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ab75d24c-050f-4326-8c98-7a9f9831862d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.156265 Apr 05 13:53:55.646285 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 530/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:55 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:56.663373 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:56.664094 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:56.671484 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:56.671961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:56.672725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:56.673163 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:56.807538 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:56.815519 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-00ba2774-17a9-4123-9558-c9c51cba73a0 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.156786 Apr 05 13:53:56.816112 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 553/1083] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:56 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:57.832094 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:57.832729 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:57.839025 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:57.839470 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:57.840259 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:57.840728 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:57.978439 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:57.985828 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a97ea91-dd03-4dca-957c-6c1cea874387 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.157518 Apr 05 13:53:57.986392 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 531/1084] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:57 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:53:59.002965 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:53:59.003594 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:53:59.009824 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:59.010269 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:59.011021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:53:59.011452 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:53:59.143448 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:53:59.150678 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-68ab73f5-d79d-414f-8702-5addc457e0aa tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.151527 Apr 05 13:53:59.151249 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 554/1085] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:53:58 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:00.167907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:00.168521 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:00.175608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:00.176060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:00.176941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:00.177379 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:00.310285 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:00.317470 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-840af67c-41a7-4709-8211-1f9a00578930 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.153457 Apr 05 13:54:00.318035 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 532/1086] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:00 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:54:01.334122 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:01.334735 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:01.341114 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:01.341598 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:01.342374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:01.342808 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:01.480964 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:01.488887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-504959ed-916c-432c-8bcf-0693aebc068e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.158632 Apr 05 13:54:01.489455 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 555/1087] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:01 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:01.779674 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-5d256059-0914-4b33-9e85-64d02a58aabd req-162b9106-e9ad-498d-be27-2cdd48b75e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cdf3f9-e14a-4b05-a303-bcd408f993eb", "name": "network-vif-plugged", "status": "completed", "tag": "ecac3f52-db01-476e-8a60-e585d080e046"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:54:01.788343 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5d256059-0914-4b33-9e85-64d02a58aabd req-162b9106-e9ad-498d-be27-2cdd48b75e4d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:01.788788 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5d256059-0914-4b33-9e85-64d02a58aabd req-162b9106-e9ad-498d-be27-2cdd48b75e4d service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:01.799364 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-5d256059-0914-4b33-9e85-64d02a58aabd req-162b9106-e9ad-498d-be27-2cdd48b75e4d service nova] Creating event network-vif-plugged:ecac3f52-db01-476e-8a60-e585d080e046 for instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb on hv-cinder-83587 Apr 05 13:54:01.804540 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-5d256059-0914-4b33-9e85-64d02a58aabd req-162b9106-e9ad-498d-be27-2cdd48b75e4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085704 Apr 05 13:54:01.805112 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 533/1088] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:54:02.086423 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:02.087353 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:02.093948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.094408 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.095183 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.095659 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.126374 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3b686a18-020c-489c-b17e-3217920bbd67 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043858 Apr 05 13:54:02.126951 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 556/1089] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:54:02 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:54:02.282115 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:02.282602 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:02.288714 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.289171 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.289941 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.290448 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.320308 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ad27baf5-acc6-4aff-8751-49a889e6123d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387" status: 200 len: 194 microversion: 2.1 time: 0.042754 Apr 05 13:54:02.320886 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 534/1090] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Apr 5 13:54:02 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:54:02.332635 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:02.333131 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:02.339663 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.340262 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.340983 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.341416 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.417480 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lazy-loading 'services' on Instance uuid fa22c83d-be5e-4f5a-a41d-20204d6de425 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:54:02.488091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e827b5f0-7c60-4cfd-83dc-aa8b1cd119c8 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387" status: 202 len: 0 microversion: 2.1 time: 0.160146 Apr 05 13:54:02.488702 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 557/1091] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:54:02 2022] DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/fc83ae83-6a4f-45c9-a64e-0edc49878387 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 13:54:02.505398 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:02.506052 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:02.511987 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.512953 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.513738 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:02.514182 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:02.648947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:02.656889 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7bde7396-43a5-4cef-8435-10f090ac8e50 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1265 microversion: 2.1 time: 0.155300 Apr 05 13:54:02.657445 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 535/1092] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:02 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:03.674703 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:03.675407 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:03.682563 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:03.683021 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:03.683856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:03.684903 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:03.830627 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:03.837941 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-363d820f-f89e-4d4d-9d88-96d5dffb18b4 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1450 microversion: 2.1 time: 0.168025 Apr 05 13:54:03.838505 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 558/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:03 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:03.854846 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:03.855467 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:03.861855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:03.862310 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:03.863084 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:03.863550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:03.998101 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:04.006174 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cd061110-2a7c-4ade-9af9-b5726e57ed8a tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1450 microversion: 2.1 time: 0.154937 Apr 05 13:54:04.006754 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 536/1094] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:03 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:04.653412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:04.654105 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:04.659875 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:04.660330 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:04.661107 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:04.661550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:04.690013 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3dd34506-b020-49f7-8e3a-135f7ef20e3c tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/223745ba-ceb2-48c1-9c61-9b37d7b27446" status: 200 len: 194 microversion: 2.1 time: 0.040653 Apr 05 13:54:04.690686 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 559/1095] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Apr 5 13:54:04 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/223745ba-ceb2-48c1-9c61-9b37d7b27446 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:54:04.700937 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:04.701437 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:04.707110 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:04.707604 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:04.708377 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:04.708818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:04.787923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lazy-loading 'services' on Instance uuid fa22c83d-be5e-4f5a-a41d-20204d6de425 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 13:54:04.861716 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9445f6c9-7e32-46df-a240-28986e8a5881 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/223745ba-ceb2-48c1-9c61-9b37d7b27446" status: 202 len: 0 microversion: 2.1 time: 0.165156 Apr 05 13:54:04.865361 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 537/1096] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Apr 5 13:54:04 2022] DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments/223745ba-ceb2-48c1-9c61-9b37d7b27446 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:54:05.693607 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f8ea3184-0952-4aa3-abb6-60b8442d3927 req-e25a6a16-6866-4d92-90cc-bd030d732e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cdf3f9-e14a-4b05-a303-bcd408f993eb", "tag": "ecac3f52-db01-476e-8a60-e585d080e046"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:54:05.702671 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f8ea3184-0952-4aa3-abb6-60b8442d3927 req-e25a6a16-6866-4d92-90cc-bd030d732e16 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:05.703339 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f8ea3184-0952-4aa3-abb6-60b8442d3927 req-e25a6a16-6866-4d92-90cc-bd030d732e16 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:05.714263 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f8ea3184-0952-4aa3-abb6-60b8442d3927 req-e25a6a16-6866-4d92-90cc-bd030d732e16 service nova] Creating event network-changed:ecac3f52-db01-476e-8a60-e585d080e046 for instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb on hv-cinder-83587 Apr 05 13:54:05.719855 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f8ea3184-0952-4aa3-abb6-60b8442d3927 req-e25a6a16-6866-4d92-90cc-bd030d732e16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030049 Apr 05 13:54:05.720456 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 560/1097] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:54:06.033751 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:06.035368 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:06.044137 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.044593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.045385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.045818 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.077063 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b0012d0a-f7dc-4d76-b556-59b6a86b7d73 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048596 Apr 05 13:54:06.077984 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 538/1098] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:54:06 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 13:54:06.187286 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:06.188333 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:06.194341 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.194820 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.195626 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.196070 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.225972 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-22fc1721-c262-436d-8eef-58604f138f1f tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043884 Apr 05 13:54:06.230803 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 561/1099] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Apr 5 13:54:06 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 13:54:06.289361 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:06.289865 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:06.296766 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.297539 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.298341 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.298787 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.325185 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:54:06.405109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-55eafb65-4505-4e60-b20d-578cba7ece8d tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 204 len: 0 microversion: 2.1 time: 0.119136 Apr 05 13:54:06.405803 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 539/1100] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:54:06 2022] DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:54:06.414497 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:06.415130 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:06.421506 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.421961 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.422731 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:06.423169 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:06.565725 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:06.573259 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c581021f-d277-4a87-9892-f5a32caeeadc tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1672 microversion: 2.1 time: 0.162930 Apr 05 13:54:06.573856 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 562/1101] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:06 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:07.591872 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:07.592578 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:07.599044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:07.599514 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:07.600287 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:07.600728 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:07.736651 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:07.743928 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-60da00ed-2f1b-4184-8342-f68f2238eb8b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1672 microversion: 2.1 time: 0.157367 Apr 05 13:54:07.744481 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 540/1102] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:07 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:08.761675 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:08.762948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:08.769431 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:08.769879 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:08.770637 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:08.771091 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:08.991232 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3af744dd4f3798ec98381104575f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2edcb781e01b4c57b680098d732cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:54:08.999700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8b8ef71-767d-4408-88a3-897787945b53 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 200 len: 1672 microversion: 2.1 time: 0.241761 Apr 05 13:54:09.000565 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 563/1103] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:08 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:54:09.335582 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-1cd43dc3-8721-4882-8e65-0339715b9068 req-b4028e41-fe22-4672-bc1b-3472ecb07a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa22c83d-be5e-4f5a-a41d-20204d6de425", "name": "network-vif-deleted", "tag": "e75e4cea-332c-4c5c-b9b7-18028f80e7da"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:54:09.345363 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1cd43dc3-8721-4882-8e65-0339715b9068 req-b4028e41-fe22-4672-bc1b-3472ecb07a08 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:09.346686 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1cd43dc3-8721-4882-8e65-0339715b9068 req-b4028e41-fe22-4672-bc1b-3472ecb07a08 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:09.362810 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-1cd43dc3-8721-4882-8e65-0339715b9068 req-b4028e41-fe22-4672-bc1b-3472ecb07a08 service nova] Creating event network-vif-deleted:e75e4cea-332c-4c5c-b9b7-18028f80e7da for instance fa22c83d-be5e-4f5a-a41d-20204d6de425 on hv-cinder-83587 Apr 05 13:54:09.367593 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-1cd43dc3-8721-4882-8e65-0339715b9068 req-b4028e41-fe22-4672-bc1b-3472ecb07a08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035792 Apr 05 13:54:09.369153 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 541/1104] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:54:10.018192 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:10.018810 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:10.025243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:10.025693 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:10.026614 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:10.027059 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:10.041208 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. Apr 05 13:54:10.041845 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:54:10.042713 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a9e47368-b67b-4d68-8650-dedc5fbdd56e tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 404 len: 111 microversion: 2.1 time: 0.028696 Apr 05 13:54:10.043267 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 564/1105] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:10 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 13:54:10.053480 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a28de663-6327-48f3-8caf-a66372512e2b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '.version_select at 0x7f9bfd8c3d30>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:10.072179 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a28de663-6327-48f3-8caf-a66372512e2b tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338498836" status: 202 len: 0 microversion: 2.1 time: 0.022714 Apr 05 13:54:10.072760 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 542/1106] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Apr 5 13:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338498836 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:54:12.950721 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:12.951208 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:12.957479 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:12.957932 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:12.958700 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:12.959147 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:12.972161 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. Apr 05 13:54:12.973011 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:54:12.973830 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c3721160-334d-48aa-a87c-b20d4dbaba96 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 404 len: 111 microversion: 2.1 time: 0.027772 Apr 05 13:54:12.974355 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 565/1107] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:54:12 2022] DELETE /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:54:12.982385 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:12.983114 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: fa22c83d-be5e-4f5a-a41d-20204d6de425] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:12.989535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:12.989988 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:12.990756 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:12.991196 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:13.004325 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. Apr 05 13:54:13.004907 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance fa22c83d-be5e-4f5a-a41d-20204d6de425 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:54:13.005724 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0c50900f-bb45-497f-a8ed-41c720daabc0 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425" status: 404 len: 111 microversion: 2.1 time: 0.027268 Apr 05 13:54:13.006244 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 543/1108] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:12 2022] GET /compute/v2.1/servers/fa22c83d-be5e-4f5a-a41d-20204d6de425 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:54:14.139998 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:14.140534 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:14.146721 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:14.147171 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:14.147965 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:14.148401 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:14.161968 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. Apr 05 13:54:14.162552 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:54:14.163394 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ee35e0d-0abc-4484-b930-f0d667f54e42 tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 404 len: 111 microversion: 2.1 time: 0.027882 Apr 05 13:54:14.163947 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 566/1109] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:54:14 2022] DELETE /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:54:14.172608 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:54:14.173223 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] [instance: 9e769137-37bf-4cb2-b020-d664054c61b0] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:54:14.179386 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:14.179890 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:14.180660 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:54:14.181104 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:54:14.194475 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] HTTP exception thrown: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. Apr 05 13:54:14.195060 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] Returning 404 to user: Instance 9e769137-37bf-4cb2-b020-d664054c61b0 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:54:14.195944 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7dba46bc-b0c4-4b22-b9c7-fbb80a7cfbfa tempest-AttachVolumeTestJSON-716055870 tempest-AttachVolumeTestJSON-716055870-project] 10.222.0.59 "GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0" status: 404 len: 111 microversion: 2.1 time: 0.028178 Apr 05 13:54:14.196474 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 544/1110] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:54:14 2022] GET /compute/v2.1/servers/9e769137-37bf-4cb2-b020-d664054c61b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:55:16.210366 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:55:16.210979 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:55:21.012266 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:55:21.012887 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:55:42.731826 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:42.732477 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:42.738988 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:42.739447 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:42.740252 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:42.740688 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:42.768015 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:55:42.850426 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8ce3db5-1dff-4e38-875e-da4d89ea32cf tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 204 len: 0 microversion: 2.1 time: 0.123770 Apr 05 13:55:42.854380 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 567/1111] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:55:42 2022] DELETE /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:55:42.863165 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:42.863931 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:42.869894 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:42.870346 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:42.871141 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:42.871763 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:43.000903 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-97d4070a-15b1-414f-b5b0-3ac3821177e3 req-62fd9150-dce7-40b1-96eb-234f47a9659f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cdf3f9-e14a-4b05-a303-bcd408f993eb", "tag": "ecac3f52-db01-476e-8a60-e585d080e046"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:55:43.008855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-97d4070a-15b1-414f-b5b0-3ac3821177e3 req-62fd9150-dce7-40b1-96eb-234f47a9659f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:43.009295 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-97d4070a-15b1-414f-b5b0-3ac3821177e3 req-62fd9150-dce7-40b1-96eb-234f47a9659f service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:43.021029 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:43.021797 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-97d4070a-15b1-414f-b5b0-3ac3821177e3 req-62fd9150-dce7-40b1-96eb-234f47a9659f service nova] Creating event network-changed:ecac3f52-db01-476e-8a60-e585d080e046 for instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb on hv-cinder-83587 Apr 05 13:55:43.026999 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-97d4070a-15b1-414f-b5b0-3ac3821177e3 req-62fd9150-dce7-40b1-96eb-234f47a9659f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298198 Apr 05 13:55:43.027815 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 545/1112] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 13:55:43.032449 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a4e98c6c-ce59-4202-94a2-5a68b8f259f9 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1574 microversion: 2.1 time: 0.176399 Apr 05 13:55:43.033028 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 568/1113] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:42 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 13:55:44.050880 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:44.051459 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:44.057373 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:44.057822 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:44.058579 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:44.059012 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:44.196791 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:44.204931 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8af1e6d6-d723-4632-ad97-05616e23fac2 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1574 microversion: 2.1 time: 0.158964 Apr 05 13:55:44.205505 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 546/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:44 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:55:45.222095 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:45.222716 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:45.229406 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:45.229916 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:45.230726 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:45.231158 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:45.235219 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-5dd34711-c58f-4121-8818-598c2a49b3b0 req-82c180dd-3771-4ba8-8065-93f1ebe528b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cdf3f9-e14a-4b05-a303-bcd408f993eb", "name": "network-vif-deleted", "tag": "ecac3f52-db01-476e-8a60-e585d080e046"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:55:45.244341 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5dd34711-c58f-4121-8818-598c2a49b3b0 req-82c180dd-3771-4ba8-8065-93f1ebe528b7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:45.245668 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5dd34711-c58f-4121-8818-598c2a49b3b0 req-82c180dd-3771-4ba8-8065-93f1ebe528b7 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:45.259057 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-5dd34711-c58f-4121-8818-598c2a49b3b0 req-82c180dd-3771-4ba8-8065-93f1ebe528b7 service nova] Creating event network-vif-deleted:ecac3f52-db01-476e-8a60-e585d080e046 for instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb on hv-cinder-83587 Apr 05 13:55:45.266170 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-5dd34711-c58f-4121-8818-598c2a49b3b0 req-82c180dd-3771-4ba8-8065-93f1ebe528b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033921 Apr 05 13:55:45.266854 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 547/1115] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:55:45.303172 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:45.310495 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed5b561c-97ed-4f8b-8fbb-0d49dc18d548 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 200 len: 1389 microversion: 2.1 time: 0.093259 Apr 05 13:55:45.311256 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 569/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:45 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:55:46.328536 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:46.329238 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 81cdf3f9-e14a-4b05-a303-bcd408f993eb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:46.335280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:46.335755 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:46.336515 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:46.336947 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:46.350403 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] HTTP exception thrown: Instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb could not be found. Apr 05 13:55:46.350972 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Returning 404 to user: Instance 81cdf3f9-e14a-4b05-a303-bcd408f993eb could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:55:46.351801 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-497bb903-b06a-48ee-974b-2423e447948d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb" status: 404 len: 111 microversion: 2.1 time: 0.027933 Apr 05 13:55:46.352313 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 548/1117] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:46 2022] GET /compute/v2.1/servers/81cdf3f9-e14a-4b05-a303-bcd408f993eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:55:49.424260 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:49.424942 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:49.425900 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-c3e9302b-fb14-4584-8a68-83c4cb7b898a req-533a191e-f877-4b00-8c23-81b28c9cab3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a9bc5-b147-4321-91d0-21a2b2523db5", "tag": "03c1e3f4-74cf-4a11-aa5c-ac773207a9fd"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:55:49.431852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:49.432304 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:49.433075 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:49.433562 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:49.434346 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c3e9302b-fb14-4584-8a68-83c4cb7b898a req-533a191e-f877-4b00-8c23-81b28c9cab3a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:49.434784 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c3e9302b-fb14-4584-8a68-83c4cb7b898a req-533a191e-f877-4b00-8c23-81b28c9cab3a service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:49.446546 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-c3e9302b-fb14-4584-8a68-83c4cb7b898a req-533a191e-f877-4b00-8c23-81b28c9cab3a service nova] Creating event network-changed:03c1e3f4-74cf-4a11-aa5c-ac773207a9fd for instance 997a9bc5-b147-4321-91d0-21a2b2523db5 on hv-cinder-83587 Apr 05 13:55:49.451533 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-c3e9302b-fb14-4584-8a68-83c4cb7b898a req-533a191e-f877-4b00-8c23-81b28c9cab3a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029156 Apr 05 13:55:49.452535 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 549/1118] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:55:49.462144 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 13:55:49.553518 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bb51ae42-61cb-4348-ab7f-e89b9e066177 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 204 len: 0 microversion: 2.1 time: 0.133737 Apr 05 13:55:49.554527 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 570/1119] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:55:49 2022] DELETE /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 13:55:49.564034 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:49.565098 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:49.571793 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:49.572250 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:49.573105 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:49.573550 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:49.725116 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:49.732893 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-caeea35d-9256-42e1-ba41-972542184af6 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1577 microversion: 2.1 time: 0.173456 Apr 05 13:55:49.733489 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 550/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:49 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:55:50.751412 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:50.752080 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:50.758599 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:50.759044 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:50.759852 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:50.760287 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:50.922243 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:50.929550 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3273675f-f3ac-44e0-9983-1409207eff2d tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1577 microversion: 2.1 time: 0.183129 Apr 05 13:55:50.930122 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 571/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:50 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:55:51.780914 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-8e58bfde-40b4-4de3-8762-3c27a8a99916 req-dc6849f1-e795-4233-b3e4-377c178c8cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997a9bc5-b147-4321-91d0-21a2b2523db5", "name": "network-vif-deleted", "tag": "03c1e3f4-74cf-4a11-aa5c-ac773207a9fd"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 13:55:51.789730 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8e58bfde-40b4-4de3-8762-3c27a8a99916 req-dc6849f1-e795-4233-b3e4-377c178c8cf1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:51.790176 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8e58bfde-40b4-4de3-8762-3c27a8a99916 req-dc6849f1-e795-4233-b3e4-377c178c8cf1 service nova] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:51.801741 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-8e58bfde-40b4-4de3-8762-3c27a8a99916 req-dc6849f1-e795-4233-b3e4-377c178c8cf1 service nova] Creating event network-vif-deleted:03c1e3f4-74cf-4a11-aa5c-ac773207a9fd for instance 997a9bc5-b147-4321-91d0-21a2b2523db5 on hv-cinder-83587 Apr 05 13:55:51.806753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-8e58bfde-40b4-4de3-8762-3c27a8a99916 req-dc6849f1-e795-4233-b3e4-377c178c8cf1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030078 Apr 05 13:55:51.807371 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 551/1122] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Apr 5 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 13:55:51.946948 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:51.947520 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:51.954313 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:51.954760 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:51.955537 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:51.956003 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:52.027896 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '507ec53c995341ce805d43f85a4d72c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8d9df8c7bc47c198fe0d94abd938c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 13:55:52.036055 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f92ab163-5e52-4fb7-a136-150ea6eee791 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 200 len: 1226 microversion: 2.1 time: 0.092896 Apr 05 13:55:52.036609 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 572/1123] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:51 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 13:55:53.054109 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:53.054811 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 997a9bc5-b147-4321-91d0-21a2b2523db5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:53.061044 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.062015 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.062829 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.063272 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.076007 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] HTTP exception thrown: Instance 997a9bc5-b147-4321-91d0-21a2b2523db5 could not be found. Apr 05 13:55:53.076589 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Returning 404 to user: Instance 997a9bc5-b147-4321-91d0-21a2b2523db5 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:55:53.077940 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-11d4929f-0c36-4a01-b11a-779e54b2a01f tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5" status: 404 len: 111 microversion: 2.1 time: 0.028115 Apr 05 13:55:53.078464 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 552/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:53 2022] GET /compute/v2.1/servers/997a9bc5-b147-4321-91d0-21a2b2523db5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:55:53.520677 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:53.521194 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:53.527409 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.528488 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.529284 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.529749 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.543090 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] HTTP exception thrown: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. Apr 05 13:55:53.543704 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Returning 404 to user: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:55:53.544518 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4bfad418-3578-44e1-b176-14012f04ba31 tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 404 len: 111 microversion: 2.1 time: 0.027783 Apr 05 13:55:53.545045 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 573/1125] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Apr 5 13:55:53 2022] DELETE /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:55:53.553292 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:53.553899 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] [instance: 4e672018-0182-4460-8378-999578b50317] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 13:55:53.559615 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.560066 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.561011 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 13:55:53.561524 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Lock "1188cfe2-0516-4a8d-9d16-70266a041a17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 13:55:53.574280 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] HTTP exception thrown: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. Apr 05 13:55:53.574855 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Returning 404 to user: Instance 4e672018-0182-4460-8378-999578b50317 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 13:55:53.575753 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ce118342-8f30-41a2-bf29-86d8d4f0432e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317" status: 404 len: 111 microversion: 2.1 time: 0.026427 Apr 05 13:55:53.576260 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 553/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Apr 5 13:55:53 2022] GET /compute/v2.1/servers/4e672018-0182-4460-8378-999578b50317 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 13:55:54.854203 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0a390667-9f8d-4d41-8dbc-bf73f9f8f30e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] Calling method '.version_select at 0x7f9bfd814820>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 13:55:54.876873 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0a390667-9f8d-4d41-8dbc-bf73f9f8f30e tempest-TestVolumeBootPattern-1772221900 tempest-TestVolumeBootPattern-1772221900-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2080643478" status: 202 len: 0 microversion: 2.1 time: 0.026869 Apr 05 13:55:54.877802 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 574/1127] 10.222.0.59 () {58 vars in 1262 bytes} [Tue Apr 5 13:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2080643478 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 13:56:34.470250 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:56:34.470896 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 13:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:56:44.365576 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:56:44.366278 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 13:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:58:30.573181 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:58:30.573799 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:58:36.218782 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:58:36.219459 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:58:41.021671 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:58:41.022376 dv-cinder-835878-2-iscsi devstack@n-api.service[123520]: Tue Apr 5 13:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:58:46.527319 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:58:46.527923 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 13:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 13:59:54.478746 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 13:59:54.479585 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 13:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 14:00:04.375433 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 14:00:04.376136 dv-cinder-835878-2-iscsi devstack@n-api.service[123519]: Tue Apr 5 14:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!